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Abstract 

Let n be a large integer and A/„ be an ri by n complex matrix whose entries are independent 
(but not necessarily identically distributed) discrete random variables. The main goal of this 
paper is to prove a general upper bound for the probability that M„ is singular. 

For a constant < p < 1 and a constant positive integer r, we will define a property p- 
hounded of exponent r. Our main result shows that if the entries of Af„ satisfy this property, 
then the probability that A/„ is singular is at most {p^^^ + o(l)) . All of the results in this 
paper hold for any characteristic zero integral domain replacing the complex numbers. 

In the special case where the entries of M„ are "fair coin flips" (taking the values +1,-1 
each with probability 1/2), our general bound implies that the probability that Mn is singular 

+ o(l) j , improving on the previous best upper bound of (| + o(l)) , proved 

by Tao and Vu [U. 

In the special case where the entries of Mn are "lazy coin flips" (taking values +1,-1 each 
with probability 1/4 and value with probability 1/2), our general bound implies that the 
probability that A/„ is singular is at most (i + o(l)) , which is asymptotically sharp. 

Our method is a refinement of those from [3] and [TT]. In particular, we make a critical use of 
the Structure Theorem from [TT], which was obtained using tools from additive combinatorics. 

1 Introduction 

Let n be a large integer and Mn be an n by n random matrix whose entries are independent (but not 
necessarily identically distributed) discrete random variables taking values in the complex numbers. 
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The problem of estimating the probabiHty that M„ is singular is a basic problem in the theory of 
random matrices and combinatorics. The goal of this paper is to give a bound that applies to a 
large variety of distributions. The general statement (Theorem 12. 2p is a bit technical, so we will 
first discuss a few corollaries concerning special cases. 

The most famous special case is when the entries of M„ are independent identically distributed 
(i.i.d.) Bernoulli random variables (taking values ±1 with probability 1/2). The following conjec- 
ture has been open for quite some time: 

Conjecture 1.1. For M±i^n an n by n matrix with each entry an i.i.d. Bernoulli random variable 
taking the values +1 and —1 each with probability 1/2, 

Pr(M-|-i_„ is singular) = ^- + o(l) 

It is easy to verify that the singularity probability is at least (1/2)" by considering the probability 
that there are two equal rows (or columns). 

Even in the case of i.i.d. Bernoulli random variables, proving that the singularity probability 
is o(l) is not trivial. It was first done by Komlos in 1967 [5] (see also [6]; [9] generalizes Komlos's 
bound to other integer distributions). The first exponential bound was proven by Kahn, Komlos, 
and Szemeredi [1], who showed that Pr(M-|-i^„ is singular) < .999". This upper bound was improved 
upon by Tao and Vu in [10] to .958". A more significant improvement was obtained by the same 
authors in [TT]: 

Pr(M±i,„ is sing ular)< (^^+o(l)) . (1) 

This improvement was made possible through the discovery of a new theorem |1H Theorem 5.2] 
(which was called the Structure Theorem in [H]), which gives a complete characterization of a set 
with certain additive properties. The Structure Theorem (to be more precise, a variant of it) will 
play a critical role in the current paper as well. 

Our general result has the following corollary in the Bernoulli case: 

Pr(M±i,„ is singular) < (^-^ + o(l)^ , (2) 

which gives a slight improvement over Inequality ([ID (since 1/^2 « 0.7071 < .75). 

Let us now discuss a more general class of random matrices. Consider the random variable 7^^-* 
defined by 



+1 with probability fi/2 

with probability 1 — ^ (3) 
— 1 with probability fi/2, 

and let M^^^ be an n by n matrix with each entry an independent copy of 7*-^^ The random 

variable 7^^^ plays an important role in [H 110^ [TT]. and the matrices M^^^ are of interest in their 
own right. In fact, giving zero a large weight is a natural thing to do when one would like to 
(randomly) sparsify a matrix, a common operation used in randomized algorithms (the values of 
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±1, as the reader will see, are not so critical). Our general result implies the following upper 
bounds: 

for < ^ < ^ (4) 
for i < ^ < 1 (5) 

for < < 1. (6) 

Note that Inequality ^ implies Inequality ([1]) and that Inequality ([6]) implies Inequality ([2]) (in 
both cases setting /x = 1). 

Figure [1] summarizes the upper bounds from Inequalities ([H), ([5]), and ^ and also includes the 
following lower bounds: 

(1 - + o(l))" < Pr{M^l^ is singular) for < /i < 1 (7) 

(l-2fi+ ^/i^ + o(l)^ < Pv{M^l^ is singular) for < < 1. (8) 

These lower bounds can be derived by computing the probability that one row is all zeros (In- 
equality dlD) or that there is a dependency between two rows (Inequality ([SD). Note that in the 
case where fi < 1/2, the upper bound in Inequality ^ asymptotically equals the lower bound in 
Inequality d?]), and thus our result is the best possible in this case. We also used a Maple program 
to derive the formulas for lower bounds resulting from a dependency between three, four, or five 
rows; however, these lower bounds were inferior to those in Inequality ([7]) and Inequality ([8]). 

We will now present another corollary of the main theorem that has a somewhat different flavor. 
In this corollary, we treat partially random matrices, which may have many deterministic rows. Our 
method allows us to obtain exponential bounds so long as there are still at most clnn random rows, 
where c > is a particular constant. 

Corollary 1.2. Let p be a real constant between and 1, let c be any positive constant less than 
l/ln(l/p), and let S C C be a set of complex numbers having cardinality \S\ < 0(1). Let N^^n be an 
n by n complex matrix in which f < clnn rows contain fixed, non-random elements of S and where 
the other rows contain entries that are independent random variables taking values in S. If the 
fixed rows are linearly independent and if for every random entry a, we have max^,. Pr(a = x) < p, 
then 

Pr(iVf^„ is singular) < (y^ + 0(1))"" . 
Notice that the case f = and p = 1/2 also implies Inequality ([2]). 

Remark 1.3 (Other exponential bounds). The focus of this paper is optimizing the base of the 
exponent in bounds on the singularity probability for discrete random matrices. One main tool in 
this optimization is the use of a structure theorem similar to [111 Theorem 5.2] (see Theorem 16.11 
below); however, using such a theorem requires additional assumptions to be placed on the values 
that can appear as entries, and in particular, this is why we assume in Corollary 11.21 that the set S 
has cardinality IS*! < 0(1) and that f < clnn. If one is interested in an exponential bound where 



Pt{M^I^ is singular) < (1 - ^ + 0(1))' 



Pr(Mg„ is singular; 



< 



2/i + 1 



+ 0(1) 



Pt{M^I^ is singular) < ( Wl - 2^f + ^//^ + o(l) 
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Figure 1: Let P{fJ,) := lim Pr yMj^-^,^ is singularj , where M^-/^ is the n by n matrix with 

independent random entries taking the value with probability 1—// and the values +1 and —1 each 
with probability /i/2. The solid lines denote the upper bounds on -P(/u) given by Inequalities (jl]), 
([5|), and and the dashed lines denote the lower bounds given by Inequalities ([7]) and ([8]). The 
upper and lower bounds coincide for < ^ < ^, and the shaded area shows the difference between 
the best known upper and lower bounds for ^ < < 1. The straight line segments from the 
point (0, 1) to (1/2, 1/2) and from the point (1/2, 1/2) to (1,3/4) represent the best upper bounds 
we have derived using the ideas in [11], and the curve 1 — 2// + for < fi < 1 represents a 
sometimes-better upper bound we have derived by adding a new idea. Note that the upper bounds 
given here also apply to the singularity probability of a random matrix with independent entries 
having arbitrary symmetric distributions in a set S of complex numbers, so long as each entry is 
with probability 1 — and the cardinality of S is jSI < 0(1) (see Corollarv l3.ip . 
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there are no conditions on f or on the set S (at the expense of having an unspecified constant for 
the base of the exponential), one can follow the analysis in [10], which does not make use of a 
structure theorem, along with ideas in this paper to get a result of the following form: 

Theorem 1.4. For every e > there exists 6 > such that the following holds. Let N^^n be an n 
by n complex matrix in which f rows contain fixed, non-random entries and where the other rows 
contain entries that are independent discrete random variables. If the fixed rows have co-rank k 
and if for every random entry a, we have max^: Pr(a = x) < 1 — e, then for all sufficiently large n 

Pr(iVf,„ has co-rank > k) < {I - 6)"~K 

Note that Theorem 11.41 holds for any f and k, and so in particular, an exponential bound on the 
singularity probability is achieved whenever A; = and f < cn, where c < 1 is a constant. Also note 
that the theorem allows the random entries to have discrete distributions taking infinitely many 
values. Corollary 13.61 proves a version of Theorem II .41 with a much better exponential bound, given 
some additional conditions. 

The structure of the rest of the paper is as follows. In Section[2]we define p-bounded of exponent 
r and state the main theorem of this paper. In Section [3l we discuss some corollaries of Theorem l2.2[ 
In particular, we will: 

(A) prove Inequalities ([1]), ([5]), and ([6]); 

(B) prove general bounds on the singularity probability for discrete random matrices with entries 
that have symmetric distributions and with entries that have asymmetric distributions; 

(C) Prove a version of Corollarv 11.21 (namely, Corollarv l3.5p that holds for up to o(n) fixed rows, 
assuming that the entries in the fixed rows take integer values between —C and C for any 
positive constant C; and 

(D) prove that the probability that random matrices with integer entries have a rational eigenvalue 
is exponentially small. 

In Section [H we discuss Lemma 14. H a result that is proved in [13] using standard tools from 
algebraic number theory and algebraic geometry. Lemma [4.11 reduces the question of bounding the 
singularity probability of a random matrix with entries in C to a question of bounding the singularity 
probability of a random matrix with entries in TLjQTL for some large prime Q (in fact, it is possible 
to replace C with any characteristic zero integral domain) . The proof of Theorem 12.21 is outlined 
in Section [U where we also prove some of the easier lemmas needed for the theorem. In Section [6l 
we state a structure theorem (Theorem 16. ip that completes the proof of our Theorem 12.21 and that 
is very similar to [111 Theorem 5.2] (which is the Structure Theorem in [H]). We discuss the proof 
of Theorem 16. 1[ which uses discrete Fourier analysis and tools from additive combinatorics, in 
Sections [7] and [8l Finally, in Section [9] we show that the entire argument proving Theorem 12.21 can 
be generalized to random complex matrices with f rows of the matrix containing fixed, non-random 
entries, so long as f < clnn for a particular constant c > (this leads to Corollarv 1 1.2p . 

2 The general theorem 

To prove the results in Inequalities ([T|) and ^ (and also the results in [4] and [10]), one basic idea 
is to replace entries of a random matrix with independent copies of the random variable 7^'') or 
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2'-)/(a') (see Equation ([3])). One key idea in proving the more general results of the current paper 
is replacing the entries of a random matrix with more complicated symmetric discrete random 
variables. 

A generalized arithmetic progression of rank r is a set of the form {vq + mivi + • • • + m^v^ : 
< Mi/ 2}, where the Vi are elements of a Z-module and the mj and Mi > are integers. Note 
that whenever the term "symmetric" is used in this paper, it will apply to the distribution of a 
random variable or to a generalized arithmetic progression; in particular, the term will never apply 
to matrices. Also, throughout this paper we will use the notation 

e{x) := exp{2TTix). 

The following definition lies at the heart of our analysis. 

Definition 2.1 (p-bounded of exponent r). Let p be a positive constant such that < p < 1 
and let r be a positive integer constant. A random variable a taking values in the integers (or, 
respectively, the integers modulo some large prime Q) is p-bounded of exponent r if 

(i) maxa; Pr(a = x) < p, and 

if there exists a constant q where < q < p and a Z- valued (or, respectively, a Z/QZ- valued) 
symmetric random variable P^^^ taking the value with probability 1 — /x = p such that the 
following two conditions hold: 

(ii) q < miux Pr(/?('^) = x) and max^; Pr = x) < p, and 

(iii) the following inequality holds for every t G R: 

|]E(e(at))r <E(e(/?(^)t)) 

Here, if the values of a and P^^^ are in Z/QZ, we view those values as integers in the range 
(—(5/2,(5/2) (note that each element in Z/QZ has a unique such integer representation). 

We will define p-bounded of exponent r for collections of random variables below, but first we 
note that the conditions above are easy to verify in practice. In particular, if we have a symmetric 
random variable 

bi with probability HPi/2 
bi with probability fJ-pi/2 

with probability 1 — /i (9) 
—bi with probability HPi/2 

—bi with probability HPe/2, 
where bs £ 7^ for all s (or, respectively, bg £ 'LjQ'L for all s), then condition (iii) becomes 

|E(e(Qt))|'' < E (^e(/3(^)t)) = 1 - + /i cos 27r6^t, (10) 



= < 
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where the equahty on the right-hand side is a simple expected value computation. 

We say that a collection of random variables {ajk}^f,^i is p-bounded of exponent r if each ajk 
is p-bounded of exponent r with the same constants p, q, and r; and, importantly, the same value of 
H = 1 — p. We also make the critical assumption that the set of all values that can be taken by the 
Pj'^ has cardinality 0(1) (a relaxation of this assumption is discussed in Remark IS.Sh . However, 

the definition of /jj^^ is otherwise allowed to vary with j and k. Also, we will use S to denote the 
set of all possible values taken by the random variables Ojk, and we will assume that the cardinality 
of S is at most \S\ < n^W. 

If a takes non-integer values in C, we need to map those values to a finite field of prime order 
so that we may use Definition 12.11 and for this task we will apply Lemma 14.11 which was proved 
in [13]. We say that a is p-bounded of exponent r if and only if for each prime Q in an infinite 
sequence of primes produced by Lemma l4.ll we have (j)Q{(y) is p-bounded of exponent r, where (j)Q 
is the ring homomorphism described in Lemma [4.1l that maps S, the finite set of all possible values 
taken by the aj^, into Z/QZ in such a way that for any matrix := (sjk) with entries in S, the 
determinant of Nn is zero if and only if the determinant of (j)Q{Nn) := {(pQisjk)) is zero. 

Theorem 2.2. Let p be a positive constant such that < p < 1, let r be a positive integer 
constant, and let S be a generalized arithmetic progression in the complex numbers with rank 0(1) 
(independent of n) and with cardinality at most \S\ < n"^"'\ Let Nn be an n by n matrix with 
entries ajk, each of which is an independent random variable taking values in S. If the collection 
of random variables {oijk}i<j,k<n is p -bounded of exponent r, then 

Pr(iV„ is singular) < {p^/'' + o(l))". 

In the motivating examples of Section [T] (excluding Corollary II. 2p , we discussed the case where 
the entries of the matrix are i.i.d.; however, in general the distributions of the entries are al- 
lowed to differ (and even depend on n), so long as the entries all take values in the same struc- 
tured set S described above. The condition that S has additive structure seems to be an arti- 
fact of the proof (in particular, at certain points in the proof of Theorem 16.11 we need the set 
|Sj=i ^3 ■ Xj £ S for all j| to have cardinality at most n°("')). The easiest way to guarantee that 
S has the required structure is to assume that the set of values taken by all the ajk has cardinality 
at most 0(1), and this is the approach we take for the corollaries in Section [3l since it also makes 
it easy to demonstrate that the collection of entries is p-bounded of exponent r. 

Remark 2.3 (Strict positivity in Inequality (jlOp ). Note that the constants fi,ps,bs must be such 
that the right-hand side of Equation (jlOp is non-negative. It turns out for the proof of Theorem 12.21 
that we will need slightly more. At one point in the proof, we will apply Lemma 17.31 for which we 
we must assume that there exists a very small constant e_i > such that E(e(/?j^^t)) > e_i for all 

t and for all used in the definition of p-bounded of exponent r. Of course, if the expectations 
are not strictly larger than e_i, we can simply reduce fi by e_i > 0. Then, since we are assuming 
1 — fj, = p, we clearly have that all the ajk are {p + e_i)-bounded of exponent r (by using /jj^ ^^^^ 

instead of /^j^^) and we have that E(e(/3j^"'-'^t)) > e_i > 0. Since Theorem 12.21 would thus yield 
a bound of [{p + e_i)^/^ -|- o(l))" for every e_i > 0, we can conclude a bound of [p^^^ + o(l))" by 
letting e„i tend to 0. Thus, without loss of generality, we will assume that E{e{p\'^h)) > e_i for 
all t and for all (3^^^ used in the definition of p-bounded of exponent r. 
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3 Some corollaries of Theorem 12.21 



In this section, we will state a number of corollaries of Theorem \2.2\ starting with short proofs 
of Inequalities ([H), ([5]), and ([6]). The two most interesting results in this section will be more 
general: first (in Section [32]) , we will show an exponential bound on the singularity probability for 
a matrix with independent entries each a symmetric random variable taking values in S* C C, where 

< 0(1) and assuming that each entry takes the value with probability 1 — and second (in 
Section [3. 3p . we will describe a similar (and sometimes better) bound when the condition that the 
random variables have symmetric distributions is replaced with the assumption that no entry takes 
a value with probability greater than p. In the first case, the bound will depend only the value of 
/i, and in the second case, the bound will depend only on the value of p. In Section 13.41 we will 
show an exponential bound on the singularity probability for an n by n matrix with f = o{n) fixed 
rows containing small integer values and with the remaining rows containing independent random 
variables taking values in C C, where \S\ < 0(1) (this is similar to Corollary II. 21 which is proved 
in Section [9|) . Finally, in Section 13.51 we will prove an exponential upper bound on the probability 
that a random integer matrix has a rational eigenvalue. 

In each corollary, we will use the definition of p-bounded of exponent 1 and of exponent 2. The 
definition of p-bounded of exponent 2 is particularly useful, since then the absolute value on the 
left-hand side of Inequality (jlOp is automatically dealt with; however, when fi is small (for example 
whenever /_f < 1/2), one can get better bounds by using p-bounded of exponent 1. We have not yet 
found an example where the best possible bound from Theorem 12.21 is found by using p-bounded 
of an exponent higher than 2. 



3.1 Proving Inequalities (jlj), ([5]), and ([6]) 

To prove Inequality ([4]), we note for < /U < ^ that (using the definition in Equation ([3]) of 7^/^)) 

E(e(7(^)t)) = 1 -/i + /Ucos(27rt), 

and thus (1 — /u)-bounded of exponent 1 (i.e., take := 7^^^), and so Inequality ^ follows 

from Theorem 12.21 

To prove Inequality ([5]), we note for ^ < < 1 that 



|1 - /i + /Ucos(27rt)| < ( ^^^^ ] + (1 - /u)cos(27rt) + ( ^ ] cos(47rt) 



(the inequality above may be checked by squaring both sides and expanding as polynomials in 
cos(27rt)). Thus, we can take 



'+2 


with probability 


2n-l 
8 


-2 


with probability 


2/i-l 
8 


+1 


with probability 


1-ti 
2 


-1 


with probability 


2 


.0 


with probability 


2^l+l 

4 



to see that 

is Jl- 

-bounded of exponent 1, and so Inequality jS]) follows from Theorem l2.2l 
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To prove Inequality dH), we note for < ;U < 1 that 



E(e(7(^)t)) ^ = |1 -/i + ^cos(27rt)|^ = 1 - 2^+ ^/x^ + 2(1 - ^)^cos(27rt) + cos(47rt). 



Thus, we can take 



+2 


2 

with probabihty ^ 




-2 


2 

with probabihty ^ 




+1 


with probability (1 




-1 


with probability (1 






with probability 1 - 


- 2^ + |/i 


I -bounded of exponent 2, 


and so 



to see that 7^^^ is ^1 — 2^ + -/^^^ -bounded of exponent 2, and so Inequality ([6j) follows from 
Theorem [221 

3.2 Matrices with entries having symmetric distributions 



In this subsection, we will prove a singularity bound for an n by n matrix Njf'^ for which each entry 
is a symmetric discrete random variable taking the value with probability 1 — /u. 

Corollary 3.1. Let S be a set of complex numbers with cardinality \S\ < 0{1). If Nn^^ is an n by 
n matrix in which each entry is an independent symmetric complex random variable taking values 
in S and taking the value with probability 1 — /i, then 



Vv[n!^^ is singular) < 



(l_^, + o(l))n 



+ 0(1) 



1 - 2/i + 1/^2 + 0(1; 



/or < /i < i 
forl<fi<l 
forO< fi<l. 



In particular, the same upper bounds as in Inequalities and ([6|) (which are shown in 

Figure QP apply to the singularity probability for Mjf"^ . 



Proof. Let Uij be an entry of N^t^ . 

1—fj., we may write Oij = jlj^rjij, where 7^-^^ is an independent copy of 7^^^ as defined in Equation ([3 



Since aij is symmetric and takes the value with probability 



and rjij is a random variable that shares no values with —r]ij. This description of aij was inspired 
by [ij, and it allows us to condition on r]ij and then use the remaining randomness in j^j^ to get a 
bound on the singularity probability. In particular, 

Pr(iV^'') is singular) = ^ Pr(7V^^) is singular |{77ij = aj}) Pr{{T]ij = dj}), 

where the sum runs over all (n2)-tuples (cjj)i<ij<„ of possible values taken by random variables 
r]ij. Since X](cjj) ^^({"Hij = Cjj}) = 1, we can complete the proof by proving an exponential bound 

on Pr(M''^ is singular I {r/jj = Cij}), and we will use Theorem 12.21 for this task. 
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Consider the random matrix Nn 



, where the i,j entry is the random variable Cjj7, 



V Hj 

take values in S, a set with cardinality 



for some constant Cij. Note that the entries of Nn 

0(1), and let (pQ be the map from Lemma l4.ll which lets us pass to the case where Njf^ 
has entries in 'LjQ'L. Defining Qij := 2Tr(j)Q{cij), we compute 



Ee 



< < 



^ij^if )^) = |1 - ^ + ^COs(%t)| 



1 — fi + fi cos{6ijt) 

^ + (1 - ^) cos(%i) + (^) cos(2%t 



3 Ll 

1-2^1 + + 2(1 - fi)ncos{eijt) + y cos{2eijt] 



We have thus shown that the entries of A', 



{Vij—^ij} 



are 



1/2 



for < < i, 

for ^ < ;U < 1, and 

for < < 1. 



1^1 — fi) -bounded of exponent 1 for < ^ < -, 

^ ^ — ^ -bounded of exponent 1 for — < fi < 1, and 
3 \ 

1 — 2^-1- —fi^ j -bounded of exponent 2 for < ;U < 1. 



Applying Theorem 12.21 completes the proof. 



□ 



Corollary 13.11 is tight for < ^ < ^ , since the probability of a row of all zeroes occurring is 
{1 — fi + o(l))"; however, for any specific case. Theorem 12.21 can usually prove better upper bounds 
than those given by Corollary [3TTJ 

For example, consider the case of a matrix M^^^ ^ with each entry an independent copy of 
the symmetric random variable 

+2 with probability j 



a 



—2 with probability ^ 

-|-1 with probability ^ 

— 1 with probability ^ 

with probability 1 — ^ 



Corollary 3.2. -For M^^^^ -ti} defined above, we have 

r(i-^+o(i)r 

Pr(M|^^2 ±1} „ singular) < < 



/or < ^ < if 



1 - 2^-h -ho(l)) forO<fi<l. 
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Proof. By the definition of a^f^^ we have 



16 



Ee(a(^)t) =1- fi + - cos(27rt) + - cos(47ri), for < < — 

(i.e., the right-hand side of the equation above is non-negative for such /x), which proves the first 
bound. 

Also, we have 

Ee{a^^h) ^ = 1 - 2/i ^/i^ + ( /i - cos(27rt) + ( /U - IfiA cos(47rt) 



for < /i < 1, which proves the second bound. 



2 2 

-|- ^ cos(67rt) + ^ cos(87rt) 



(m) 



We also have the following lower bounds for the singularity probability of M^_^^ ^: 



□ 



(l-/. + o(l)r 

(1 - 2/X + 5/^2/4 + o(l))" 



(from one row of all zeroes) 
(from a two-row dependency) 



(11) 
(12) 



The results of Corollary 13.21 and the corresponding lower bounds are shown in Figure [2l and one 
should note that the upper bounds are substantially better than those guaranteed by Corollarv l3.11 



3.3 Random matrices with entries having arbitrary distributions 

A useful feature of the definition of p-bounded of exponent 2 is that it lets one bound the singularity 
probability of matrices with independent discrete random variables that are asymmetric. 

Corollary 3.3. Let p be a constant such that < p < 1 and let S C C be a set with cardinality 
\S\ < 0{1). If Nn is an n by n matrix with independent random entries taking values in S such 
that for any entry a, we have max^ Pr(a = x) < p, then 

FT{Nn is singular) < (y/p + o(l))". 

We will need the following slightly more general corollary in Section 13.41 For a set A and an 
integer m, we will use the notation mA := {YlJLi '^i • '^i ^ '^11^=1 '^j '■ '^j ^ 

Corollary 3.4. Let p be a constant such that < p < 1, let S C C be a set with cardinality \S\ < 
0{1), and let X„ be an n by n matrix with fixed, non-random entries in n°^"'\S U { — 1,0, l})*-^^^). 
If Nn is an n by n matrix with independent random entries taking values in S such that for any 
entry a, we have max^,. Pr(a = x) < p, then 

Pr{Xn + Nn is singular) < (^+ o(l))"'. 

Note that that Corollary 13.41 implies Corollary 13.31 by taking X„ to be the matrix of all zeroes. 
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Figure 2: Let -P(^) := lim„_»oo ^M||^2 -ti} „ is singularj , where -^{±2±i}n n by n 

matrix with independent random entries taking the value with probabiUty 1 — /i and the values 
+2, —2, +1, —1 each with probability This figure summarizes the upper bounds on -P(/i) from 
Corollary 13.21 and the lower bounds from Displays (jlip and (jl2p . The best upper bounds (shown 
in thick solid lines) match the best lower bounds (thick dashed lines) for < fi < and it is not 
hard to improve the upper bound a small amount by finding a bound (of exponent 1) to bridge 
the discontinuity. One should note that even as stated above, the upper bounds are substantially 
better than those given by Corollarv 13.11 (which are shown in Figured]). The shaded area represents 
the gap between the upper and lower bounds. 
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Proof of Corollary \3.4\ Let aij be an entry in Nn- Our goal is to describe in a two-step random 
process, condition on one of the steps, and then use the randomness in the other step to bound the 
singularity probability. The conditioning approach is the same as that used in the symmetric case 
(Corollary 13. ip and was inspired by [T]. The conditioning argument is useful since some entries of 
the random matrix may take some values with very small probability (i.e. probability less than any 
constant); recall that while the entries of the random matrix always take values in a fixed set S of 
cardinality 0(1), the distributions of those random variables within S are allowed to vary with n. 
(Note that making use of Remark 18.51 would provide an alternate way of dealing with entries that 
take some values with very small probability.) 

Say that Uij takes the values vi,. . . ,vt with probabilities . . . , respectively, where qi > 
Q2 >■■■'> Qt- Define new random variables rjijk such that for some iq and ii, the values taken by 
r^ijk are tii^, Ujo+i, . . . , Vi^+i^ with corresponding probabilities Qi^/pu, Qio+i/Pk, • • • , Qio+h/Pk, where 
Pk ■= SiLi Sio+i- Thus, we can write 



a,; 



rjiji with probability pi 
r]ij2 with probability p2 

.Viji with probability p£. 



(13) 



Furthermore, the r/jjfc can be constructed so that Pk ^ p for every k, so that p/2 < p^ for 1 < A: < 
£ — 1, and so that no two rjijk with different /c's ever take the same value. 

There are two cases to consider for the technical reason that p^ is not necessarily bounded below 
by a constant. Let e > be a very small constant, so for example p/2 > e. Case 1 is when e < pi, 
and in this case each p^ is bounded below by e and above by p. We will consider Case 1 first and 
then discuss the small changes needed to deal with Case 2. 

As in the proof of Corollary 13.11 we will condition on the values taken by the r/jj^ in order to 
prove a bound on the singularity probability. We have that 

Pr(X„ + Nn is singular) = ^ Pr(X„ + Nn is singular] {t?^^^ = c^-fc}) Pr({7?ijfc = Q^fc}), 

i^ijk ) 

where the sum runs over all possible values (cijk) that the T]ijk can take. Thus, it is sufficient to 

which has 



prove a bound on the singularity probability for the random matrix X„ + N„ 
random entries 



{'nijk=Cijk} 



with probability pi 
with probability p2 



^Xij + Ciji with probability p£, 

take values in (S U {—1, 0, 1})*^^^^ a generalized 

{Vijk=Cijk} 

arithmetic progression with rank 0(1) and cardinality at most n°^"'\ and let (pQ be the map from 



where Xij and the Cijk are constants. 
Note the entries of X„ + N„ 
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Lemma |4. 11 which lets us pass to the case where X„ + Nn has entries in Z/QZ. Defining 

{riijk=Cijk} 

Oijk := 2Tr(j)Q{cijk) and letting a[j be an i.i.d. copy of onj, we compute 

\Ee{<j)Q{xij + aij)t)\'^ = Ee (^(/yqixij + aij - Xij - 5'jj)t^ = Ee (4>Q{aij - 5'jj)t^ 

e 

= ^Pk + '^ PfclPfe2COs((%fci - %fc2)*)- 

k=l l<ki<k2<e 

Thus, Xij + Oij is ^X]fc=i I'fc) "bounded of exponent 2 (using the constant q = in Definition 12.11 
so q does not depend on n). Given that < pfc < p for every fc, it is not hard to show 
that 'Yfk=iPk ^ P < P + s-i^d so from Definition 12.11 we see that the collection {xij + oiij : 
(Xij has corresponding probability pg > e} is {p + e)-bounded of exponent 2. We are thus finished 
with Case 1. 

Case 2 is when the decomposition of Oij given in Equation (jl3p has pi < e. In this case we need 
to modify Equation (fT3|) slightly, deleting rnj^ and replacing 7yjj(£_i) with a new variable r/^^-^^.^^ 
that takes all the values previously taken by rjiji and by rjij(^^_i) with the appropriate probabilities. 
Thus, in Case 2, we have that p/2 < Pk < p + e for all 1 < /c < ^ — 1, showing that each p^ is 
bounded below by a constant and is bounded above by p + e (here we are using p£_i to denote the 
probability that aij draws a value from the random variable 

For Case 2, we use exactly the same reasoning as in Case 1 above to show that such entries of 
Xn + Nn are ( X]fc=i Pfc ) "bounded of exponent 2 (using the constant q = < in 

Definition 12.11 so q does not depend on n) . Noting that J2k=L Pk P ~^ ^ using Definition 12.11 
we see that the collection {xij + aij : aij has corresponding probability pi < e} is {p + e)-bounded 
of exponent 2. 

Combining Case 1 and Case 2, we have that the collection {xij + 5jj} is (p + e)-bounded of 
exponent 2, and so by and by Theorem 12.21 we have that Pr(X„ + Nn is singular) < 

(vp+7+o(i)r. 

The constant e > was chosen arbitrarily, and so letting e tend to zero, we get that 
Pr{Xn + Nn is singular I {r/ijfc = djk}) < (v^+ o(l))" . 

□ 



3.4 Partially random matrices 

In this subsection, we prove a bound on the singularity probability for partly random matrices 
where many rows are deterministic. 

Corollary 3.5. Let p be a real constant between and 1, let K he a large positive constant, and 
let S C C be a set of complex numbers having cardinality \S\ < K. Let Nf n be an n by n matrix 
in which f rows contain fixed, non-random integers between —K and K and where the other rows 
contain entries that are independent random variables taking values in S. If ^ < o{n), if the f fixed 
rows are linearly independent, and if for every random entry a, we have max^ Pr(Q = x) < p, then 

Fi[{Nj^n is singular) < (y^ + o(l))"~^ . 
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Corollary [33] applies to partly random matrices with f = o(n) fixed, non-random rows containing 
integers bounded by a constant and with random entries taking at most 0(1) values in the complex 
numbers. Corollary 11.2^ on the other hand, holds with the fixed entries also allowed to take values 
in the complex numbers and gives a sligtly better bound, but additionally requires f < O(lnri) 
(which is far smaller in general than o{n)). Proving Corollary 11.21 requires mirroring the entire 
argument used to prove the main theorem (Theorem 12. 2p in the case where f rows contain fixed, 
non-random entires, and we discuss this argument in Section [9l Proving Corollary 13.51 however, 
can be done directly from Theorem 12.21 ^ we will show below. First, we will state a generalization 
of Corollary [331 

Corollary 3.6. Let p be a real constant between and 1, let K be a large positive constant, and 
let S C C be a set of complex numbers having cardinality \S\ < K. Let N^^n an n by n matrix 
in which f rows contain fixed, non-random integers between —K and K and where the other rows 
contain entries that are independent random variables taking values in S. If f < o{n), if the fixed 
rows have co-rank k, and if for every random entry a, we have maxx Pr(a = x) < p, then 

Pr(iVf,„ has co-rank > k) < (v^ + o(l))'^"^ 

To obtain Corollary 13.61 from Corollary 13.51 fiiid ^ collection C of f — /c linearly independent 
rows among the deterministic rows. Replace the rest of the deterministic rows with a collection C 
of rows containing integer values between —K and K such that C is linearly independent from C. 
Finally, apply Corollary 13.51 to the new partially random matrix whose deterministic rows are from 
C U C, thus proving Corollary 13.61 

Proof of Corollaru \3.5[ By reordering the rows and columns, we may write 



A 


B 


C 


D 



where A is an f by f non-random invertible matrix, i? is an f by n — f non-random matrix, C is an 
n — f by f random matrix, and Z) is an n — f by n — f random matrix. Note that N^^n is singular if 
and only if there exists a vector v such that N^^n^ = 0. Let vi be the first f coordinates of v and 
let V2 be the remaining n — f coordinates. Then -/Vj nV = if and only if 

^vi + = 0, and 
Cvi + Z?V2 = 0. 

Since A is invertible, these two equations are satisfied if and only if {—CA~^B + D)w2 = 0, that 
is, if and only if the random matrix —CA~^B + D is singular. 

We want to show that every entry that can appear in —CA~^B is an element of n°^"^ {S U {—1, 0, 1}) 
By the cofactor formula for A~^, we know that the i,j entry of A~^ is (— l)*"''-' (det ^jj)/ det A, 
where Aij is the f — 1 by f — 1 matrix formed by deleting the i-th row and j-th column of A. 
Thus, A~^ = gj^^, where the i,j entry of A is ( — 1 )*"'"■' det ^j^. By the volume formula for the 
determinant, we know that |det74| is at most the product of the lengths of the row vectors of A; 
and thus |det A| < n°^") (here we need that A has integer entries between —K and K, where K 
is a constant, and that f < o(n)). Similarly, we have |det Ajjl < n°^^\ Every entry of A is thus 
in n°^"^{ — 1, 0, 1}, every entry of C is in S, and every entry of B is in 0(1){ — 1, 0, 1}; thus, every 
entry of -CAB is an element of n''(")(5 U {-1, 0, 1}). 
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Conditioning on the values taken by all the entries in C, we have 

Pr(A''f^„ is singular) = Pr{—CA~^B + D is singular) 

= Pi{-CA'^B + Dis singular|C = (c^)) Pr(C = (qj)), (14) 

(cii) 

where the sum runs over all possible matrices (cjj) that C can produce. Considering the entries in 
C = (cij) to be fixed (note that A and B are fixed by assumption), we now need to bound 

Fii-{cij)A'^B + D is singular) = Fr{-{cij)AB + {detA)D is singular). 

Note that every entry of —{cij)AB is an element of n''^") {S U {-1, 0, 1})*^^^^ and that the random 
matrix (det^)D has entries that take values in the fixed set {(det^)s : s G S} having cardinality 
0(1). Thus, by Corollary 13.41 we have that 

Fr{-{cij)AB + {det A)D is singular) < (v^ + o(l))""^ 

Plugging this bound back into Equation (jl4p completes the proof. □ 



3.5 Integer matrices and rational eigenvalues 

Let r]k be the random variable taking the values —k,—k + l,...,k — l,k each with equal probability, 
and let M„ be the n by n matrix where each entry is an independent copy of r]k- In [7], Martin 
and Wong show that for any e > 0, 

Pr(M„ has a rational eigenvalue) < ' ^ , 

where c(n, e) is a constant depending on n and e. (One goal in is to study this bound as k goes 
to oo while n is fixed, which is why c(n, e) is allowed to depend on n.) 

Below, we prove a similar result for random integer matrices with entries between —k and k 
(with k fixed), where we allow each entry to have a different (independent) distribution and we 
also allow the distributions to be very general. 

Corollary 3.7. Fix a positive integer k, and let Mk^n be a random integer matrix with independent 
entries, each of which takes values in the set {—k, —k + 1, . . . ,k — l,k}. Let c be a constant such 
that for every entry a, we have max_fc<a;<fc Pr(a = x) < c/k. Then 



Pr(M/c^,„ has a rational eigenvalue) < ( — + o(l) 




where the o(l) term goes to zero as n goes to oo. 

For example, in the case where each independent entry has the uniform distribution on {—A;, —k + 
1, . . . , k — 1, k} (as in [7j), one can set c = 1/2 in the corollary above. 

Proof. The proof given below follows the same outline as the main theorem of [7], with Corollary ll.2l 
replacing an appeal to [3 Lemma 1]. 

The characteristic polynomial for M^^n is monic with integer coefficients, and thus the only 
possible rational eigenvalues are integers (by the rational roots theorem). Every eigenvalue of M/^^^ 
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has absolute value at most nk (see [TJ Lemma 4]); thus, the only possible integer eigenvalues are 
between —nk and nk. 

The matrix M^^n has A as an eigenvalue if and only if Adk,n — A/ is singular (where / is the n 
by n identity matrix) . By Corollary 11.21 (with f = 0) , we have 

Pr(Mfc,„ - XI is singular) < + o{r 

Using the union bound, we have 

Pr(Mfc^„ has a rational eigenvalue) = Pr(Mfc^„ — XI is singular, for some A G {—nk, . . . , nk}) 

nk 

is singular) 



\=—nk 

< {2nk+l) (\ T + o{l) 



<(£ + o(l) 



k 

n/2 



□ 



4 Random matrices with complex entries: A reduction technique 

The original work on discrete random matrices in [Sj HI [TOl [TT] is concerned with matrices having 
integer entries, which can also be viewed as matrices with entries in Z/QZ where Q is a very large 
prime. In this section we show that one can pass from a (random) matrix with entries in C to 
one with entries in TLjQTL where Q is an arbitrarily large prime number, all without affecting the 
probability that the determinant is zero, thanks to the following lemma. 

Lemma 4.1 ([l3]). Let S be a finite subset ofC. There exist infinitely many primes Q such that 
there is a ring homomorphism (j)Q : Z[S'] — > Z/QZ satisfying the following two properties: 

(i) the map (j)Q is injective on S, and 

(a) for any n by n matrix {sij)i<ij<n with entries Sij G S, we have 



det ^(sij)i<i,j<n^ =0 if and only if det (^{(pqisij)) 



l<i j<n 



In order to apply this lemma, let us point out that the proof of Theorem 12.21 which is discussed 
in Sections [5] through [HI works exclusively in Z/QZ; though at various points, it is necessary to 
assume Q is extremely large with respect to n and various constants. For this paper, S will be the 
set of all possible values taken by the random variables ajk- Recall that by assumption, l^l < n°("), 
so in particular, S is finite. 

Remark 4.2 (On the size of Q). When we apply Lemma l4.H we will take Q > exp(exp(Cn)) for 
some constant C in order for Freiman-type theorems such as |lll Theorem 6.3] (which is restated 
in Theorem 18.11 below) to apply, and we will also choose Q large enough so that the integral 
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approximation in Inequality (j44p holds and so that Q is large with respect to various constants. 
One should note that while Q can be taken arbitrarily large with respect to n, we cannot choose 
Q so that it is arbitrarily large with respect to (Pq{s) for all s £ S, where S is the set of all values 
that could appear in the given random matrix. For example, if \/2 G S, then the smallest positive 
integer representative for 4>q{\/2) must be larger than y/Q (since ((/)q(\/2))^ = 2 in IjjQTL). Finally, 
if we were in a situation where S* C Q, then we could avoid using Lemma [4.11 altogether by clearing 
denominators to pass to Z and then take Q ~ exp(exp(Cn)), as is done in [llj . 

Lemma 14.11 is a corollary of the main theorem of [13] and its proof is given in detail in |13[ 
Section 6] . The paper |13j also contains further applications of the method used to prove Lemma [4.H 
for example proving a sum-product result for the complex numbers and proving a Szemeredi- 
Trotter-type result for the complex numbers, where the applications follow from the analogous 
results for Z/Q where Q is a prime (see [3]). The results in |13j . including Lemma [4.1l all go through 
with the complex numbers being replaced by any characteristic zero integral domain. Thus, the 
results stated in Sections [H [2l and [3] above for the complex numbers C also all go through with C 
replaced by any characteristic zero integral domain. For example. Corollary 13.31 becomes 

Corollary 4.3. Let p be a constant such that < p < I and let D be a characteristic zero integral 
domain. Let S C D have cardinality \S\ < 0(1). If Nn is an n by n matrix with independent 
random entries, each taking values in S, such that for every entry a, we have max^,. Pr(a = x) < p, 
then 

Fv{Nn is singular) < (y^ + o(1))"'. 

5 Proof of the main theorem (Theorem 12.21) 

The proof of Theorem 12.21 very closely follows the proof of Theorem 1.2] . Our goal is to highlight 
the changes that need to be made to generalize the proof in [11] so that it proves Theorem 12. 2[ A 
reader interested in the details of the proof of Theorem 12.21 should read this paper alongside of [TT] . 
Throughout the proof, we will assume that n is sufficiently large, and we will allow constants hidden 
in the o(-) and O(-) notation to depend on the constants C-i, eo, ei, e2,p, t, CMedDimj CLgDimj clOj 
and Cm- The constants e_i, eo, ei, €2 should be considered very small, and, in fact, we will let them 
tend to zero to prove the full strength of Theorem 12.21 The constants p, q, r, CMcdDim, CLgDim, clo; 
and Cm can be thought of as absolute, except possibly for depending on each other. 

5.1 Definitions and preliminaries 

Given an n by n matrix Nn with entries aij , we assume that the collection of independent random 
variables {(^ij}i<ij<n is p-bounded of exponent r for some fixed constants p, q, and r (here, q is 
the constant from Definition 1 2 . 1 1 which is independent of n). We also assume that each aij takes at 
most n"*-") distinct values. Using Lemma l4.ll we may assume without loss of generality that each 
aij takes values in 'LjQ'L for some very large prime Q. The entirety of the proof will take place over 
the field Z/QZ, and so terminology such as "linearly independent", "span", "dimension", "rank" 
and so forth will always be with respect to the field Z/QZ. 

Let Xi := (aj^i, . . . , aj,n) denote the i-th row of A^^. We note that A„ has determinant zero if and 
only if there is a linear dependency among the rows Xi. It has been shown (see |10l Lemma 5.1] and 
also [4]) that the dominant contribution to the singularity probability comes from the Xi spanning 
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a hyperplane (of dimension n — 1). In particular, 

Pr (iV„ is singular) = ^ Pr(^y), (15) 

V a non— trivial 
hyperplane in (Z/QZ)" 

where Ay denotes the event that Xi,. . . ,Xn span V, and non-trivial means that V contains the 
origin, V is spanned by vectors in 5" (where S is the set of all possible values that can occur in 
A^„), and Fi{Xi e V) > for all i. 

As in [11], we will divide the non-trivial hyperplanes into classes, since it is then sufficient 
to show that the sum of Pi(Av) over all V in a particular class is at most (p^/*" + o(l))". 

Definition 5.1 (combinatorial dimension). Let V := ■ < a < n'^,a G Z}. For any d± £ V 
such that d± > ^, we define the combinatorial Grassmannian GT{d±) to be the set of all non-trivial 
hyperplanes V in {'L/Q'L)'^ such that 

^n-d±+l/n ^ Pj.(-^. g -j/) < p^-rfi. (16) 

l<i<n 

For d± = 0, we define Gr(0) to be the set of all non-trivial hyperplanes such that 

max Pr(Xj G F) < p". 

l<i<n 

We will refer to d± as the combinatorial dimension of V . 

Note that GT{d±) = for d± > n — 1 + 1/n (by Lemma iB.ip . We will consider hyperplanes 
V with combinatorial dimension in three main regions: d± small, d± medium-sized, and d± large. 
The two lemmas and the proposition below suffice to prove Theorem 12.21 

Lemma 5.2 (Small combinatorial dimension, [4], [10], [H]). For any 5 > we have 

d±eV s.t. p"-'*±<5" VeGT{d±) 

In proving Theorem 12.21 we will take 6 = {p + CMedDimCo)^^'^ to take care of all small d± not 
covered by Proposition 15.41 below. 

Proof. The reasoning here is the same as in |1H Lemma 2.3], making use of fact that Pr{Xi & V) < 
maxi<j<„Pr(Xj ^ V) < p"-~'^± < J". In particular, 

n 

Fi{Av) <Y.^^ i{Xj}i<j<n \ {X^} spans V) Pr(X, G V), 

i=l 

which completes the proof since the summing the right-hand side over all V is at most n maxj Pr(Xj G 
V) (note that an instance of the vectors {Xj}i<j<„, \ {Xi} can span at most one hyperplane). □ 

Lemma 5.3 (Large combinatorial dimension, [l].|10j.[TT|). We have 

J2 E Pr(^v)<(p + o(l))" 

d^eV s.t. '^LgPim <„n-d± V£Gr{d±) 
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Here we choose the constant CLgOim so that CLgOim > cloP ^^"y^i where clo is the constant 
from the Littlewood-Offord inequahty (see Lemma lA.ll in Appendix and q is the constant from 
Definition EH 

Proof. Our proof is essentially the same as [111 Lemma 2.4]. Fix V G Gr((i-|-), where < 
Let imax be an index such that Vi[Xi^^^ S F) = maxi<j<„ Pr(Xj G V). By assumption, 

\/ 7i y ([TL 




Noting that Xi^^^ G 1/ if and only if Xi^^^ is orthogonal to the normal vector for F, we have by 
Lemma lA.ll that 

where k is the number of nonzero coordinates in the normal vector to V . Combining the two 
inequalities above shows that k < n/2. 
Thus, we have 

(['there exists a vector v with afj \ 
< most n/2 nonzero coordinates > j 
^ _ - . Isuch that A''„ • V = )/ 



d±GO s.t. ^^<P 



<ip + o(l))" (by Lemma IX2l) 



(Lemma IA.2I is a natural generalization of [H Section 3.1]; see also [6], \W\ Lemma 5.1], and [21 
Lemma 14.10].) □ 

Proposition 5.4 (Medium combinatorial dimension estimate). Let < eq be a constant much 
smaller than 1, and let d± £ D be such that {p + CMcdDimeo)"^'' < p"^'^* < ^g^™ _ Then 

Pr{Av)<o{ir. 

VeGr(d±) 

Here we choose the constant CMedDim so that CMedDim > (igg + Cm), where Cm is some absolute 
constant such that < Cm < 1 (the here comes from /U as defined in Section [5?2] below: in pT] . 
it happens that the constant Cm is also taken to be 

To prove Theorem 12.21 we can simply combine Lemma 15.21 with 6 = {p + CMedDimCo)^^^ ; 
Lemma 15.31 and Proposition 15.41 Thus, proving Proposition 15.41 will complete the proof of Theo- 
rem [221 To prove Proposition 15.41 as in [111 Proposition 2.5], we will separate hyperplanes V of 
medium combinatorial dimension into two classes, which we will call exceptional and unexceptional 
(see Definition I5.5p . See [HI Section 3] for motivation. The unexceptional case will be proved in 
the remainder of this section, and the exceptional case will be proved in Sections [H [3 and [HI 

The results in [10] and [3] were derived using the ideas that we will use for the unexceptional 
medium combinatorial dimension case. The idea of considering the exceptional case separately 
in [11] (and using tools from additive combinatorics in the exceptional case) is what lead to the 
improvement of Inequality ([T]), which gives a bound of asymptotically (|) , over the .999" bound 
in [1]. 
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5.2 Proof of the medium combinatorial dimension 

Before defining exceptional and unexceptional hyperplanes, we will need some new notation. By 
assumption, the collection of random variables {Q!ij}i<ij<n is p-bounded of exponent r with a 
constant fj, = 1— p, with random variables /J^j*^ corresponding to each Oij, and with a constant < 
q <p (see Definition 12. ip . We also define a constant slightly smaller than /i, namely fi := — 

We will let Yr.= (y 1,1; • • • ) yi,n) ■— (Pi I 1 ■ ■ ■ 1 Pin) denote another row vector that corresponds to 
the row vector Xi {p[^ comes from the definition of p-bounded of exponent r). Also, we will let 





ZU := (0, ...,0,yi,fc,tart;----yi,fcond'0'---'0)' (17) 



where k^t&n '■= |_(^ ~ l)r J ^ ^end := L^^J • The vector Z*j^ can be thought of as the fc-th 
segment of Yi (out of r roughly equal segments). Note that Yi and Z*^. are both defined using 
/i := — not ^. Finally, let ei be a positive constant that is small with respect to eo, Cm, and 
r. 

Definition 5.5 (exceptional and unexceptional). Consider a hyperplane V of medium combinato- 
rial dimension (that is, d± satisfies the condition in Proposition 15. 4p . We say V is unexceptional if 
there exists an iq where ^- < iq <n and there exists a Uq where 1 <kQ <r such that 



mi«cjPr(X, G V)] < e,Fv{Zl,^ G V). 



We say V is exceptional if for every i where 1 < i < n and for every k where 1 < < r we have 

ei Pr(Z*, GV)< max {Pr(X, G V)}. (18) 

l<j<n 

In particular, there exists i^ax such that Pr(Xjj^^^ £ V) = maxi<j<„{Pr(Xj G V)}; and so if V is 
exceptional, then 

ei Pt{ZI^^^, G F) < Pr(X,„,,, G V) for every k. (19) 
We will refer to Xi^^^ as the exceptional row. 

Inequality (jlOp following Definition l2.1l can be used to give another relationship between Pr(Z* ^ G 
y) and Pr(Xjj^^^ G V) that, together with Inequality (jl9p . will be of critical importance in Section[71 
Proposition 15.41 follows from the two lemmas below, so long as ei is chosen suitably small with 
respect to eo, Cm, and r. 

Lemma 5.6 (Unexceptional space estimate). We have 

V(^Gr(d±): V is unexceptional 

Lemma 5.7 (Exceptional space estimate). We have 

VSiGv{d±): V is exceptional 

We will prove Lemma 15.61 in Section 15.31 and we will prove Lemma 15.71 in Section [6l 
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5.3 The unexceptional medium combinatorial dimension case 

The general idea for the case of an unexceptional hyperplane V is to replace some of the rows Xi 
in the matrix A^^^ with rows that concentrate more sharply on the subspace V. In the case where 

the exponent r = 1, replacing a row Xi with Yi := {P^^ , ■ ■ ■ is successful; however, in the 

exponent r = 2 case, for example, replacing the entire row results in a bound that is off by an 
exponential factor. We solve this problem by replacing Xi with only half of Yi (with the other 
half of the entries being zero). This idea easily extends to any integer r > 2 and is the motivation 
for defining the vectors Z*f^ to have all zeros except for roughly n/r coordinates, as is done in 
Equation (jl7p . The basic utility of Z*^ (from Definition 15. 5p is that it concentrates more sharply 
on the unexceptional subspace V than the vector Xi for any i. 

Let Z*^ be the vector from the definition of unexceptional (Definition 15. 5p such that Pr(Xj G 
V) < ei Pic{Z*^ G V) for every i, and set Z := Z*^ Let m be the closest integer to , where 
Cm is a small positive absolute constant (for example, in [11], Cm is taken to be ■^)- Finally, let 
Zi, . . . , Zm be copies of Z, independent of each other and of Xi, . . . , X„. 

Lemma 5.8 (see Lemma 4.4 in [H]). Let By^m be the event that Zi, . . . , Zm are linearly independent 
and lie in V. Then, 

Proof. The argument follows the same reasoning as |1H Lemma 4.4], however, the quantity 2'^±~"' 
in [11] should be replaced by maxi<j<„Pr(Xj G V). Details are provided in Appendix [Bl □ 

To conclude the proof of Lemma [5. 61 we follow the "row-swapping" argument at the end of [11^ 
Section 4], with the small change of bounding Pr(Xj G V) by max Pr(Xj G V), which we use in 

l<i<n 

place of the quantity 2'^±~'^. Details are provided in Appendix [Bl 

6 Analyzing the exceptional medium combinatorial dimension case 

The approach for exceptional V in [11] is very different from that used in the unexceptional case 
or in the large or small combinatorial dimension cases. Using some powerful tools from additive 
combinatorics, the general idea is to put exceptional hyperplanes V in correspondence with a 
particular additive structure called a generalized arithmetic progression, and then to show that the 
number of the particular generalized arithmetic progressions that arise in this way is exceedingly 
small. The key to this approach is a structure theorem — namely, [IH Theorem 5.3]. In this 
section, we state a slightly modified structure theorem (Theorem 16. ip . and then we show how to 
use Theorem 16. II to prove Lemma [5. 71 In the beginning of Section [TJ we outline the changes needed 
to prove the the structure theorem for our current context, and in Sections [7| and [8] we provide 
details. 

Before stating the structure theorem, we need some definitions and notation. A generalized 
arithmetic progression of rank r is a set of the form 

P = {vo+ mivi H h m-c : \mi\ < Mi/2}, 

where the basis vectors vo,vi, . . . ,Vx are elements of a Z- module (here, Z/QZ) and where the 
dimensions Mi, . . . , are positive integers. We say that Vi has corresponding dimension Mi. For 



22 



a given element a = vq + mivi + • • • + in P, we refer to mi, . . . , as coefficients for a. A 
generalized arithmetic progression P is symmetric if vq = 0, and P is proper if for each a € P, the 
there is a unique r-tuple (mi, . . . ,mr) with |mj| < Mj/2 that gives the coefficients for a. If P is 
proper and symmetric, we define the P-norm \\a\\p of an element a E P to be 




We will use the notation mP, where m is a positive integer, to denote the set {X^^ILi Xi : Xi £ P} 
and the notation P™, where m is a positive integer, to denote the set {HI^i ^« • ^ ^ 
is a generalized arithmetic progression of rank r, then so is mP, while P™", on the other hand, is 
a generalized arithmetic progression of rank at most r"^. Also note that |mP| < m'^|P| and that 
|P™| < |P|™ 

Let V be an exceptional hyperplane of medium combinatorial dimension in Gr{d±) and let 
-'^imax = (o^ii • • • )CKn) be the exceptional row (here we are using aj as shorthand for ai^axj)- Let 
(/?i^\...,/3i^)) be the row of random variables corresponding to Xi^_^^^ from the definition of p- 
bounded of exponent r, and let hj^g with 1 < j < n and 1 < s < £j be the values taken by (3^^ (see 

Equation ([9]) for the definition of Pj^'^). 

Given an exceptional hyperplane V, there exists a representation of the form 

V = {{xi,X2, . . . ,Xn) £ {Z/QZy'' : xiOi + X2O2 H h 2;„a„ = 0} 

for some elements oi, 02, an G Z/QZ. We will call ai, 02, . . . , an the defining coordinates of V. 
Finally, let dj := bj^iOj. We will refer to (ai, . . . , dn) as the scaled defining coordinates of V. Note 
that once ^max is fixed, so are the elements ^j^i* AVe should also note that the choice of \ among 
bj^s for 1 < s < is arbitrary — since Pj^^ takes the values bj^s each with probability at least q, any 
value of s will do; and so we have taken s = 1 for convenience. 

Let H denote the highly rational numbers, that is, those numbers in 'LjQ'L of the form ajb 
(mod Q) where a, b are integers such that |a| , |6| < n°("^ and 6 7^ 0. The highly rational numbers 
were defined in |1H Section 8], and we will need a small extension for the current paper, due to the 
fact that we are using the scaled defining coordinates of V instead of simply the defining coordinates 
of V . If we were to assume that 6j^i was an 0(1) integer for all j and that every possible value taken 
by aij was an 0(1) integer for all i, j, then we could still use the same definition of highly rational 
as in [11]. However, if there is a bj^\ or an entry OLij in the matrix Nn that ever takes an irrational 
value, then when we pass to TLjQTL using Lemma 14.11 we have to account for values possibly on 
the order of Q (see Remark 14. 2p . and the highly rational numbers are not sufficient for this task. 
We can overcome this difficulty by extending to the highly T-rational numbers, which contain the 
highly rational numbers along with all the values in a structured set T (described below). We will 
now give a rigorous definition the highly T-rational numbers. 

Let r be a generalized arithmetic progression in 'LjQ'L with rank 0(1) and having cardinality 
at most n°^'^\ As in the definition of p-bounded of exponent r (Definition 12. Ih . we will take S 
to be the generalized arithmetic progression containing all possible values in 'LjQ'L taken by the 
random variables a^j that are the entries of Nn\ thus, by assumption \S\< n°^"'\ By the definition 

of p-bounded of exponent r, we know that all of the random variables P^j^ take values in a set with 
cardinality 0(1). Thus, there is a symmetric generalized arithmetic progression T with rank 0(1) 
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and cardinality |T| < n°(") such that T contains 5, such that T contains the set {—1, 0, 1}, and such 
that T contains all the values taken by the Plj^ ■ To construct T from S, one can, for example, add 

each distinct value taken by a (3^j^ as a new basis vector v' with corresponding dimension M' := 3 
(say). 

A highly T-rational number h is any element of TLjQTL of the form a/&, where a,b E n°^'^'^T^^^\ 
Note that therefore, the cardinality of the highly T-rational numbers is at most [n'^^i'^) \T\)'~^^^'^ = 
where d = 0(1) is the rank of T (here we used the fact that |T| < n°(")). 

Theorem 6.1 (Structure Theorem). There is a constant C = C{e-i,€o,ei,€2,q,r, fx) such that 
the following holds. Let V be an exceptional hyperplane and let ai,...,a„ be its scaled defining 
coordinates (as described above). Then there exist integers 

1 < r < C 

and Ml , . . . , > 1 with the volume bound 

Mi...M,<CPr(X,_GF)-i 
and nonzero elements vi, . . . € Z/QZ such that the following holds 

• (i) (Scaled defining coordinates lie in a progression) The symmetric generalized arithmetic 
progression 

P := {mivi H h m^Vr : -Mi/2 < rui < Mi/2} 

is proper and contains all of the Oj . 

• (a) (Bounded norm) The aj have small P-norm: 

n 

Y,\\a,\\l<C. 
i=i 

• (Hi) (Rational T-commensurability) The set {vi, . . . , v-c} U {ai, . . . , a„} is contained in the set 

{hvi : h is highly T-rational} . 

Note that unlike [TI], part (iii) above does not necessarily place {vi, . . . , v^} U {ai, . . . , a„} in a 
simple arithmetic progression. 

We will discuss the proof of the structure theorem in Sections [7] and [51 In the remainder of this 
section, we will discuss how to use the structure theorem to prove Lemma 15.71 

Fix d± of medium combinatorial dimension (see Proposition 15. 4p . Using independence of the 
rows, we have 

n 

VeGr{d±): VeGT{d±): i=l 

V is exceptional V is exceptional 

< \{V £ Gv{d±) : V is exceptional}] • ( max Pr(Xi G V)] . (20) 
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In Section 5], it is shown using Theorem 16.1( 1) and (ii) and Gaussian-type methods (and 
the fact that r is bounded by a constant) that 



\{V G Gr{d±) : V is exceptional}] < - — - ^ (l + ii'^^^Mi • • • M,j , 

{j;i,...,i;t} 

where the sum runs over all possible values for r, for the Mj, and for vi, . . . ,Vx:. By Theorem 16. H 
we know that r < C = 0(1) and that Mi < M1M2 ■ ■ ■ M, < CPr(Xi„^^^ G < 0(l/p"); thus, 

there are at most n°(") choices for r and the Mj. Furthermore, there are at most Q — 1 choices for 
vi (since vi 7^ 0), and once the value for vi has been fixed, (iii) tells us that there are at most n"^"^ 
choices for {v2, ■ ■ ■ ,fr} (since |n°'^"-'T'^( 

1)1 < j^oW). Thus, the sum runs over at most n"*-"^ terms. 
(This is the point in the proof where it is essential that n°^^^T^^^^ has cardinality n"^'^\) 
Plugging the volume bound on Mi ■ ■ ■ M^ into the previous displayed inequality, we have 

\{V e Gi{d±) : V is exceptional}] < (^1 + n~^CPT{Xi^^^ e V^)"^)" 

= n-t+°(")Pr(X,_Gy)-", (21) 

usmg the fact that Pr{Xi^^^ € V) < ^i^, which is a consequence of d± being of medium 
combinatorial dimension. Plugging in Inequality ()2ip into Inequality (|20p and summing over all d± 
of medium combinatorial dimension completes the proof of Lemma 15.71 (recall that by assumption 
maxi<i<„Pr(Xi e V) = Pr(Xi_ E V)). 



7 Halasz-type arguments 

The proof of the structure theorem has two main ingredients: tools from additive combinatorics, 
and Halasz-type arguments using discrete Fourier analysis. Our proof of Theorem 16.11 will follow 
the proof of |1H Theorem 5.2] very closely. We will use results about additive combinatorics from 
im Section 6] directly, and we will discuss below the extent to which the Halasz-type arguments of 
[111 Section 7] need to be modified to work for our current context. The proof of Theorem 16.11 will 
be given in Section [8] using results from the current section, [TTl Section 6], [TTl Section 7], and [HI 
Section 8] . Our Section [8] follows |1H Section 8] closely, with a few modifications to prove rational 
T-commensurability instead of only rational commensurability. 

In this section we discuss modifications to the lemmas in [11^ Section 7] that are needed in order 
to prove Theorem 16.11 

We will use eQ(-) to denote the primitive character 

eQ{x) := exp{27rix/Q). 

Let 

^max be the index of the exceptional row, so for every 1 < A; < r we have 

ei Pr(Z*^^^,, GV)< Pr(X,^,, E V), (22) 

and recall that by Definition 15.51 we have Pr(Xjj^^^ G V) = maxjPr(Xj E V). Let (ai, . . . , ««) := 
^imax with the corresponding random variables . . . , P^^^) from the definition of p-bounded of 
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exponent r (see Definition 12.11 and Equation ([9])), and let (ai, . . . , a„) be the defining coordinates 
of V. Then, using the Fourier expansion, we can compute 



Pr(X,_Gy)=E(l|^^_,,.|)=E 



^ Cez/QZ j=i J 



1 " 



n 



l/r 



^ E n ( 1 - + E^'i.^ cos(2^6,-, a,-^/g) ] (23) 



l/r 



Q 



<U^<Z:_^k^V)'/\ (24) 

/c=l 

where the last line is an application of Holder's inequality. 
Define 

fiO := n h - + ^ J^p,,.cos(27r6,,,a,e/Q) , (25) 

i=l \ s=l J 

:= 1 - /^ + /^E^J'^^°'^(^^^J>'^-?'^/^) ' ^"^"^ 
9k{0 ■= n 1 + E^J>'^°'^(^^^J>"j^/'3) ' (27) 



{k-l)^<j<k^ 

n 

where fj, := fi — j^, as defined in Section [5T2l Note that /(■?) = /}(0- 

We will need the following analog of pT| Lemma 7.1]: 
Lemma 7.1. For a// ^ G Ij/QZ, we have 

n r 

j=i k=i 

Proof. This inequality may be proven pointwise (for each j after expanding out the definition of 
Qk) using the convexity of the log function, just as in the proof of [111 Lemma 7.1] (see also [10^ 
Lemma 7.1]. □ 
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Let £2 be sufficiently small compared to ei (we will specify how small in Inequality (j33p while 
proving Lemma l7.2p . Following [11], we define the spectrum A C 'LjQ'L of {6i^iai,... ,&n.iffln} = 
{ai, . . . , a„,} (the scaled defining coordinates of F) to be 

A := G Z/QZ : /(^ > £2}. (28) 

Let denote the distance from x G M to the nearest integer. Using the elementary inequality 

1 

100 



cos(27r2;) < 1 — t^tt we have 



n '■J 

fiO < exp I --ii-^^p,., ||6,,.a,e/Q||i/^ I (29) 

j=l s=l 

{l^Pj,i — 2^ since min^; Pr(/jj'^^ = x) > q hy Definition I2.ip . 
Thus, there is a constant C{e2,q,r) such that 

1/2 , . 1/2 

EII^^-^/^IIm/J = ( E ll^^--i"^-^/^llM/d <^(e2,g,r), (30) 



1 /2 

for every ^ G A. (E.g., the constant C{e2,q,r) := ^^In (^^^^ suffices.) 
Lemma 7.2. There exists a constant C depending on e^i, eQ,ei, €2, q,r, and /x such that 

C'lQ Pr(X,_ eV)< |A| < CQPr(X,_ E y). (31) 
Furthermore, for every integer k > 4: we have 

Proof. Our goal is to bound X^^gA/(0 from above and below, and then pass to bounds on |A| 
using the fact that £2 < /(^) < 1 for all ^ G A. 
Note that 

^ E f^^^ - P^(^».nax e 1^) (by Equation ([25]) and Equation ([23])). 



27 



Also, 



1 1 " T 

- ^2 " ( n E f'^^^) I (Holder's inequality) 



, A,'=l 



< el (- ) Pr(X,,^,, G V) (by Inequality ([22 



For the lower bound, we have 

E/(^)= E /(e)-E/(^) 

SeA CGZ/QZ €^A 

> QPr(X,_ GV)- '-^ gPr(X,_ G V) 

ei 

= QPr(X,_Gy)fl-^2__j 
We can choose £2 sufficiently small with respect to ei and 1 — so that, for example, 



1 - > i (33) 

ei 2 



For the upper bound, we have 

E/(o< E /(^) 



«eA 

r 

< Q n P^(^Lax,fc e y)^/'- (Inequality dM])) 

fc=i 

<Q-Pr(Xi„_ GF) (Inequality ([22])) 

Thus, we have shown that X^^g^ /(^ = G(QPr(Xi,„^^ G F)). Since €2 < /(O < 1 for all ^ G A, 
we have proven Inequality ([3T]) . 

Making use of [111 Lemma 6.4], we can prove Inequality ()32p by showing |4A| < C |A| for some 
constant C. Using Lemma [7.31 b elow (for which we need to assume strict positivity of E(e(/?]^^i))— 
see Remark 12. 3p . we have that there exists a constant c := c(e_i, £2) such that 

/(O >c(e_i,e2), 
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for every ^ G 4A. Thus, 



< (^^—^) - Pl^(^^.a. &V)=C\A\, 

\c{e-i,e2)J ei 

for some constant C. This completes the proof of Lemma 17.21 □ 

We now state and prove a lemma showing that /(^) is at least a constant for all ^ G 4A. In 
the lemma below is unnecessary because an inequality following from [ll^ Inequality (30)] (which 
corresponds to Inequality (pO]) ) and the triangle inequality suffices. 

Lemma 7.3. Let A and f be defined as in Equation (j28p and Equation (|25p . respectively. If G 4A, 

ln(lA2)N 320000 



A'^ote t/iai c(e_i,e2) is a constant. 

Proof. Note that Inequality (|29p implies that for any ^' G A we have 

£. \ 1/2 

Thus, by the triangle inequality, we have for any ^ G 4A that 

1/2 



1/2 



EE^^-.^ii^^-.^«^-^/^iim/J -Hv"^"w) ■ ^^^^ 



^i=l s=l 

Fix ^ G 4A. Let /cq be the number of indices j such that 



2 1 

100// ^Pj-, ||6j-,aj^/g||^/2 > -, 

s=l 



and without loss of generality, say that these indices are j = 1,2,... , /cq- Squaring Inequality (j34p . 
we see that < In ( ^ ) , and so we have 

200/1 — /J V / ' 



A;o < 320000r In 



which is a constant. Thus, for the vast majority of the indices j, namely j = /cq + 1, + 2, . . . , n, 
we have 

2 1 

100/i^Pj> ||6j,^aj^/Q||^/2 < -. (35) 

s=l 
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We may now compute that 



l/r 



/(C) •= n U ~ + mE^J> cos(27r6j- sOj^/Q) 



l/r 



- ^-1 n I ^ ~ + ^E^-J> cos{27Tbj^saj£,/Q) 

j=ko+l 



s=l 



l/r 



i=ko+l 



> e_{ exp 



200^ 



j=fco+l «=1 



> e 



320000 Inf — 



1 



ln{l/e2) 



This completes the proof. 



2^ exp 1^-320000 In 

320000 



(since /(^') > e-i for any £J by the as- 
sumption of strict positivity — see Re- 
mark d^])) 

(since cos(27rx) > 1 — 100 ll^Hgy^ and 
the factors are ah positive by Inequal- 
ity dSSI) 



{l~x> for < x < .79) 
(by Inequality ((M)) ') 

□ 



We have shown that the spectrum A has small doubling, and the next step is to use this fact 
to show that a set containing most of the scaled defining coordinates aj also has small doubling. 
Towards that end, we will use the A-norm from [11], which is defined as follows: for x G Z/QZ, let 
ll^ll^ be defined by 

1/2 



\X\\ 



Note that < < 1 for all x and that the triangle inequality holds: ||x -|- y\\^ < \\x\\j^ + \\y\ 

We also have that 



^ E W^^/QWm)'^" + ( ui2 E 



2 ^l/2 



2(^Eii^^/^IIm/^)' 



/2 



56A 



Thus, squaring Inequality ()30p and summing over all ^ G A, we have 

n 

^||a,||i<4C(e2,(?,r) =: C . 



(36) 



We will now show that the set of all x with small A-norm, which by Inequality (j36p includes most 
of the dj, has small doubling. 
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Lemma 7.4. [IH Lemma 7.4] There is a constant C such that the following holds. Let A C 'LjQ'L 
denote the "Bohr set": 

A:={x€Z/QZ:\\x\\^<-^}. 

Then we have 

C~'PriX,^.^ G Vr' < \A\ <\A + A\< CPr(Xi_ G VyK 

The proof of Lemma 17.41 is the same as in [11] , with the small modification that aj should 
be replaced with aj := bj^iaj and the quantity 2'^±~"' should be replaced with Pr(Xjj^^^ G V) 
(and, of course, the field F in [11] should be replaced with Tj/QZ). Also, one should note that 
[TTl Inequality (30)], [HI Inequality (31)], and [HI Inequality (32)] correspond to, respectively. 
Inequalities and (1321) . 

In the next section, we will complete the proof of the structure theorem using the lemma above. 

8 Proof of the Structure Theorem (Theorem 16.11) 

The key to proving the structure theorem is an application of Freiman's Theorem for finite fields. 

Theorem 8.1 (see Lemma 6.3 in |llj). For any constant C there are constants x and 5 such that 
the following holds. Let A he a non-empty subset ofL/QZ, a finite field of prime order Q, such that 
\A + A\ < C\A\. Then, if Q is sufficiently large depending on \ A\, there is a symmetric generalized 
arithmetic progression P of rank r such that A C P and |^|/|P| > 6. 

Note that by Lemma r4.1l we can assume that Q is sufficiently large with respect to |^| < C Pr(Xjj^^^ G 
V)~^ < C(l/p)" (this follows from V being of medium combinatorial dimension). 

The set A from Lemma 17.41 satisfies |A + A| < C^|^|, where C < 0(1), and also contains 
all but 0(1) of the scaled defining coordinates aj, since aj ^ A implies that > 1/100 and 

Inequality (I36p shows that there can be at most lOOC" = 0(1) such dj. By Theorem 18.11 there 
exists a symmetric generalized arithmetic progression P = {mivi + ••• + mr^r : < Mi/2} 
containing A and satisfying the bounds: 

rank(P) = r < 0(1) and (37) 
\P\ < M1M2 • • • M, < 0(Pr(X,_ G V)-^). (38) 

The symmetric generalized arithmetic progression P is close to what is needed for Theorem 16. 1^ 
since it satisfies the required volume and rank bounds. We will show below that P can be altered in 
ways that preserve Inequalities (I37p and (I38p (except possibly for changing the implicit constants) 
so that P satisfies conditions (i) , (ii) , and (iii) of Theorem 16.11 

To show Theorem l6.1( i). we will first add the remaining scaled defining coordinates {ai, . . . , o„}\ 
P (i.e., those dj such that ||aj||y^ > 1/100) as new basis vectors v'f^ with corresponding dimensions 

equal to (say) 3. The resulting generalized arithmetic progression, which we will continue to 
call P by abuse of notation, satisfies both Inequalities (j37p and (|38p . since there are only 0(1) of 
the dj with ||aj||^ > 1/100 (by Inequality ([36]) ). Second, we need to ensure that P is proper, for 
which we will use the following lemma: 

Lemma 8.2 (cf. Lemma 9.3 in [H]). There is an absolute constant Co > 1 such that the following 
holds. Let P be a symmetric progression of rank x in a abelian group G, such that every nonzero 
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element ofG has order at least t \P\. Then there exists a proper symmetric generalized arithmetic 
progression P' of rank at most r containing P such that 

\P'\ < r^o'^Vl- 

Furthermore, if P is not proper and r > 2, then P' can be chosen to have rank an most r — 1 

One can conclude Lemma |8 . 2 1 from the proof of [111 Lemma 9.3] (the only difference is noting that 
the rank can be reduced by at least 1 if P is not proper to begin with). Note that we can always 

choose Q larger than r'-^o'^^|P| < O . 

Applying Lemma 18.21 gives us a proper symmetric generalized arithmetic progression, which 
again we call P by abuse of notation, that contains all the dj and satisfies both Inequalities (j37p 
and (f38D . 

The next task is to show that P can be further altered so to meet the condition (ii) in Theo- 
rem [6JJ Note that there are only 0(1) scaled defining coordinates dj such that > 1/100, 
and so these dj contribute only a constant to the sum X]j=i ll^illp- On the other hand, for any 
dj with llajlly^ < 1/100, we have that kdj G A C P for every positive integer k < Yooj[k~[P' 
will exploit this fact, and to do so will need the following notation. Let $p : P — > Z'^ be the map 
sending a point mivi + • • • + mrf t in the proper generalized arithmetic progression P to the unique 
r-tuple of coefficients (mi, . . . , m^). 

If the representation for dj in P is dj = mivi + • • • + m^Vx and kdj is in P, we would like to be 
able to say that the representation for kdj is kmivi + - • • + kmxVx; i.e., we hope that ^p{kdj) is equal 
to k^p{dj). If this were true, then we would have \kmi\ < Mi for 1 < i < t, which, if k is large, 
would show that ||aj||p is small. However, at this point we may well have ^p{kdj) ^ k^p{dj). A 
priori, changing this to equality would require replacing P with kP and then applying Lemma 18.21 
to get a proper symmetric generalized arithmetic progression, but since k may be large, this would 
increase the volume of P too much, violating Inequality ()38p . Luckily, the lemma below provides a 
way around this difficulty. We will say that P is (kj,Xj)-proper if ^p{kjXj) = kj^p{xj). 

Lemma 8.3. There exists an absolute constant Ci such that the following holds. Let P be a 
symmetric proper generalized arithmetic progression with rank r containing elements xi, . . . ,Xm, 
and let ki, . . . ,km be positive integers such that ijXj G P for every 1 < ij < kj and for every j. 
Then, there exists a proper symmetric generalized arithmetic progression P' of rank at most r such 
that P' contains P, 

\P'\ < r'^i'^'' |P| , and 
P is (kj,Xj)-proper for every j. 

Furthermore, if r > 2 and if there is some j for which P is not (kj,Xj)-proper, then P' can be 
chosen to have rank at most r — 1. 

The proof of this lemma relies on an application of Lemma 18.21 to 2P (which contains P) along 
with the fact that if ||aj||^ < 1/100 then kdj G P for every 1 < k < xoQp-|^- 

Proof. We proceed by induction on the rank r. For the base case, let r = 1 and consider Xj G P such 
that kjXj G P. Since P has rank 1 in this case, we have that Xj = ^p{xj)vi and kjXj = ^p{kjXi)vi. 
Combining these two equations we have kj^p{xj)vi = ^p{kjXj)vi, and dividing by vi (note that 
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we may assume that vi 7^ 0), we see that kj^p{xj) = ^p{kjXj). Thus P is (fcj, Xj)-proper for every 
3- 

For r > 2, we may assume that there is some jo such that kjf^^p{xjg) / ^p^kj^xj^) (i.e., we 
assume that P is not (fcjp, a;jp)-proper). We may assume that P has the form {rriivi + • • • + m^v,: : 
\mi\ < Mi/2}. Let M := (Mi,...,M^), and let (-M/2,M/2) denote the box {(mi,...,mr) : 
|mi| < Mi/2}. 

Let k be the largest integer such that $p(A;a;jp) = k^pixjg), so 1 < < kjg and <I>p((A; + 
l)xj^) / (A: + l)$p(2;jo). Since fcxjp G P and G P, we know that ^p{xjf^) G {-M/2, M/2) and 
$p(fcxjj = ^$p(xjo) G {-M/2, M/2); and thus, + 1)^>p(xjJ G (-M, M). This shows that 2P, 
which has dimensions 2M = (2Mi, . . . , 2Mr), is not proper, since it has two distinct representations 
for {k + '^)xj^. 

We can now apply Lemma 18.21 to 2P, thus finding a proper symmetric generalized arithmetic 
progression P' of rank at most r — 1 containing 2P (which contains P) such that 

\P'\ < r^'"^' \2P\ < r^^o'^' |P| . 

Since P' has rank at most r — 1, we have by induction that there exists P" a proper symmetric 
generalized arithmetic progression of rank at most r — 1 containing P' and such that 

\P"\ < (r- |P'| < tr'^i(i^"l)\2Cor3 |p| ^ 

and such that P" is (fcj, Xj)-proper for every j. Choosing Ci > 2Cq (for example) guarantees that 
j.Ci(r-i) ^2Cor ^ ^Cir ^ -^i^ich Completes the induction. □ 

Applying Lemma 18.31 we can generate a new proper symmetric generalized arithmetic pro- 
gression, which again we will call P by abuse of notation, such that P contains the a^, satisfies 
Inequalities (f37|) and (f38]) . and is (fcj, aj)-proper for every Oj such that ||aj||^ < 1/100, where 

'~ 200||a || — ^^ ^^^^ show that such P satisfies part (ii) of Theorem 16. 11 For dj such 
that P is (fcj, aj)-proper, we have that \kjmi\ < Mi for each 1 < i < r, and so 



ll«^llp = E^ F <E(200|l«.llA)' = 40000r||a,||^ 

i = l ^ i = l ^ ^ 4 = 1 

Thus, part (ii) of Theorem 16.11 follows from Inequality (j36p . since P is (/cj , dj)-proper for all but 
0(1) of the dj . 

The next step is to make further alterations to P so that we can prove part (iii) of Theorem 16. 11 
The key property that we will use for (iii) is to have the set of vectors {$p(aj) : 1 < j < n} span 
all of M}, and we will use a rank reduction argument on P to produce a new proper symmetric 
generalized arithmetic progression satisfying this full rank property. 

Lemma 8.4. [11] Let P he a proper symmetric generalized arithmetic progression of rank x con- 
taining a set B such that the set of vectors ^p{B) does not span W. Then there exists a symmetric 
generalized arithmetic progression P' containing P such that 

rank(P') < r — 1 and 
\P'\ < \P\ . 
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Note that the resulting P' is not necessarily proper or (/cj, aj)-proper, even if P had these properties. 

Proof. We use the same proof here as appears in [111 Section 8]. If {^p{aj) : 1 < j < n} does 
not have rank r, then it is contained is a subspace of of dimension r — 1. Thus, there exists 
an integer vector (qi, . . . , a^) with all the Ui coprime such that (ai, . . . , a^) is orthogonal to every 
vector in {$p(aj) : 1 < j < n}. Thus, for every w S TLjQTL and and any = m\V\ + • • • + ra^v^.^ 
we have that 

Oj = m\V\ + • • • + mri^r = m\{v\ — wa\) + • • • + mc(i'r — wa^. 

Since not all the are zero, we may assume that ar / 0. Setting w = fr/or so that — wa^ = 0, 
we see that P is contained in the symmetric generalized arithmetic progression 

P' := {m'lv'i + • • • + m[_^iv[_i : \m'^\ < Mi/2} 

with rank r — 1, dimensions Mi, . . . , Mc„i (which are the same as the corresponding dimensions for 
P), and basis vectors := Vi — aiVx/oL^- By construction |P'| < |-P|. □ 

We can now run the following algorithm to create a generalized arithmetic progression with 
all the desired properties. As the input, we take the generalized arithmetic progression P that we 
arrived at after applying Lemma 18.31 thus the input P contains all the Oj , satisfies Inequalities (|37|l 
and (j38p . and is (fcj, aj)-proper for every aj such that < 1/100; however, we do not yet know 

whether <I>p({aj : 1 < j < n}) spans W. 

1. If ^p{{aj : 1 < i < n}) spans M^, then do nothing; otherwise apply Lemma l8.4[ 

2. If P is proper, then do nothing; otherwise apply Lemma |8.2[ 

3. If for every Oj with ||aj||^ < 1/100 we have that P is (A;^, aj)-proper, then do nothing; 
otherwise apply Lemma 18.31 

4. If P satisfies the three properties given in steps 1, 2, and 3, halt; otherwise, return to step 1. 

Each application of a lemma in the algorithm may disrupt some property that other two lemmas 
preserve; however, we also know that each step in the algorithm either does not change P or 
reduces the rank of P by at least 1. Since the original input P has rank 0(1), the algorithm 
must terminate in 0(1) steps, giving us a generalized arithmetic progression of rank r that satisfies 
Inequalities (j37p and ()38p . satisfies conditions (i) and (ii) of Theorem 16. 11 and satisfies the condition 
that <I>p({oj : 1 < J < ra} spans all of W. 

Thus, all that is left to prove is part (iii), the claim of rational T-commensurability. Though 
we will not need it in the current section, one should recall that Theorem 16.11 is only useful 
when |n°^"')T'-^("^^ I = n°^'^\ where T is the symmetric generalized arithmetic progression containing 

{—1,0, 1} and all possible values taken by the /S^j*^ and the aij (see Section [6]). 

We say that a set W economically T-spans a set U if each u € U can be represented as a highly 
T-rational linear combination of elements in W, where each coefficient may be expressed as a/b 
where a,b E n°^'^'^T^^^^ and where the implicit constants in the o(-) and O(-) notation are uniform 
over U . 

Comparing our definitions with those from |1H Section 8] , we note that "highly rational" means 
the same thing as "highly {—1,0, l}-rational", and "economically spans" means the same thing as 
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"economically {—1,0, l}-spans". Thus, it is clear that any highly rational number is also highly T- 
rational for any T containing {—1, 0, 1}, and also the statement 'W economically spans C/" implies 
'W economically T-spans C/" for any set T containing {—1,0,1}. The remainder of this section 
paraphrases (with some notational changes) the latter portion of |1H Section 8]. 

We know that ^p[{aj : 1 < j < n} spans W^. Thus, there exists a subset U C {ai, . . . ,a„} of 
cardinality r such that ^p[U) spans M}. Renumbering if necessary, we can write U = {ai, . . . , Or}. 
It will be important later on that U has cardinality 0(1)- 

The set {vi, . . . ^v^} of basis vectors for P economically {— 1, 0, l}-spans {ai,...,a„} by the 
definition of P (note that Mi < 0(Pr(Xj^^^ e V)~^) < 0(p~") = Ji''^")), and so by Cramer's 
rule, the vectors $p(C/) economically { — 1, 0, l}-span the standard basis vectors {ei,...,er} for 
R*^. Applying (recall that <I>p is a bijection since P is proper) shows that U economically 
{-1,0, l}-spans {vi, . . .,v^}. 

Following this paragraph, we will show that there exists a single vector Vi^ where 1 < 'io < t 
such that economically T-spans U, which will show by transitivity that Vig economically T-spans 
{di, . . . , dn} (since U economically T-spans {vi, . . . , v^} which economically T-spans {di, . . . , a„}; 
the relation "economically T-spans" is transitive here since the sets U and {t;!, . . . ,Vx} have cardi- 
nality 0(1)). 

Let s be the smallest integer such that there exists a subset of cardinality s of {vi , . . . , v^} 
(by renumbering, say the set is {vi, . . . ,Vs}) so that for some nonzero d G n°(")T^(i) and some 
Cij e n°(")T'^(i) we have 

s 

ddi = CijVj for every 1 <i <n. (39) 
j=i 

Note that d does not depend on i, and so this statement is slightly stronger than having {u i, . . . , Vg} 
economically T-span {oi, . . . , dn}- Also, note that Equation (f39]) holds (for example) with s = r by 
the definition of P and since T contains {—1,0, 1}. 
We now consider two cases: 

• The n X s matrix C = {cij) has rank 1 in 'LjQ'L. In this case, di^jdi^ is highly T-rational 
for all «i,i2 (Since all the Cjj are highly T-rational). We know that U economically T-spans 
{ui,...,Ur}, and so the numbers Vi-^/vi^ are also highly T-rational (note that it is critical 
here that U has cardinality 0(1)). This means that vi (for example) economically T-spans 
{fi, . . . , Vr}, and so by transitivity vi economically T-spans U. 

• The matrix C has rank at least 2. Recall that (oi, . . . ,a„) is the normal vector for V and 
that V is spanned by (n — 1) linearly independent vectors with entries in S (recall that S 
contains all possible values taken by the Ojj). We can scale the j-th coordinate of each of these 
vectors by b'^\ to get a set of n — 1 linearly independent vectors each of which is orthogonal 
to d := (di, . . . , dn)- Among these (n— 1) linearly independent vectors that are orthogonal to 
(oi, . . . , dn), we can find at least one, say w = {b^\wi, . . . , b~\wn) that is not orthogonal to 
every column of C (since C has column rank at least 2). Let B := {bj^i : 1 < j < n}, and let 
w := w Higs ^ ~ (^1' ■ ■ ■ ' ^")- Thus w is orthogonal to d and every coordinate Wi of w is an 
element of T<^(^) ( since T contains S and B and \B\ = 0(1) by the definition of p-bounded 
of exponent r). 
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Remark 8.5. Note that the hne above is the only place in the proof where we use the as- 
sumption from the definition of p-bounded of exponent r that the P^j^ take values in a set 
with cardinality 0{1). As is evidenced here, the following weaker assumption suffices instead: 
say that for each 1 < i < n there exists a set Bi such that \Bi\ = 0(1) and such that 

Pii\ Pi2^ , ■ ■ ■ , Pin each take a nonzero value in Bi with probability at least q. In fact, this 
weaker assumption also replaces the assumption in the definition of p-bounded of exponent 
r that q < min^,. Pr {P^f = x) for every It suffices for each /?,-^^ to take one value in Bi 
with probability at least q, instead of taking every value with probability at least q. 

We may now compute: 



s In 



= dd ■ w = ddiWi = CijVjWi = CijWi vj. 

i=l i=l j=l j=l \i=l / 

Since w is not orthogonal to every column of C = (cjj), we can assume (reordering if neces- 
sary), that the coefficient for Vg above is nonzero, and thus we have 

Plugging this last equation into Equation (f39|) . we arrive at 

(n \ s—1 / n ri \ 

CisWe 1 = ^ I Cij ^ CisWi - Cis ^ CljWi I Vj. 

Since the coefficient for Oj on the left is an element of n°(")T'^(^) and the coefficient for each 
Vj on the right is an element of n°(")r'^(^), we have contradicted the minimality of s. 

Thus, we have completed the proof of the structure theorem (Theorem 16. ip . □ 



9 A generalization: f rows have fixed, non-random values 

In this section, we will give a generalization of Theorem l2.2l to the case where the random matrix 
has f < Oihin) rows that are assumed to be linearly independent and contain fixed, non-random 
entries. The proof of the generalized result is very similar to the proof of Theorem 12.21 ^iiid we will 
sketch the main differences in the two proofs below. 

Definition 9.1 (a random matrix N^n with entries in S). Let f be an integer between 1 and n, 
let 5 be a subset of a ring, and let N^^n be an n by n matrix defined as follows. For 1 < i < f 
and 1 < J < ra, let the entries Sij of A^f^„ be fixed (non-random) elements of S such that the rows 
(sj^i, . . . , Si^n) for 1 < i < f are linearly independent. For f + 1 < i < n and 1 < j < n, let the 
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entries aij of Nj^n be discrete finite random variables taking values in 5. Thus, 

Fixed rows; assumed to be lin- 



/ 

I ■51,1 


Sl,2 


\ 

Sl,n \ 


] 


«f,l 




Sf,n 


J 

> 


"f+1,1 


"f+1,2 • 


• ttf+l.n 




"f+2,1 


af+2,2 • 


• "f+2,n 




af+3,1 


af+3,2 • 


• "f+3,n 


> 


\ an,i 


an,2 


0^n,n / 





> Random rows 



Theorem 9.2. Let p be a positive constant such that < p < 1, let r be a positive integer 
constant, and let S be a generalized arithmetic progression in the complex numbers with rank 0(1) 
(independent ofn) and with cardinality at most \S\ < n°^'^\ Consider the matrix N^^^ with entries in 

S (see Definition \9.1\ above), where f < (^ 2ln(i/p) ~ '^(-'^)) If the collection of random variables 

{ojk} f+i<j<n,i<k<n is p-boundcd of exponent r, then 

Pr(Aff,„ is singular) < max + o(l))", {p + o(l))'"-f| . 

Note that the bound on the singularity probability of Nj^n for r > 2 is the same as in Theorem l2.2l 
(since for r > 2, we have n/r <^ n — c\nn = n — f). This is a reflection of the fact that only the large 
dimension case uses the randomness in all the rows simultaneously, and in that case the exponential 
bound does not depend on r. Generally speaking, the best known lower bounds on the singularity 
probability of a discrete random matrix come from a dependency among at most two random rows, 
and since Nf^^ certainly has more than two random rows, the upper bounds given in Theorem 19.21 
seem reasonable. 

Theorem 19.21 leads to Corollary 11.21 by following a conditioning argument very similar to that 
given in Section | 



9.1 Outline of the proof of Theorem 19.21 

The proof of Theorem 19.21 follows the same lines of reasoning as that of Theorem 12.21 In this 
subsection, we will state the main lemmas with the necessary modifications, and we will mention a 
few important considerations when making the modifications. 

Note that Equation (llSp , which reduces the question of singularity to one of the rows spanning 
non-trivial hyperplane of dimension n — 1 holds in the current context, using the same definition 
of Ay and "non-trivial hyperplane" (both are defined after Equation (jl5p in Section 15. ip . 

Definition 9.3 (combinatorial dimension with f fixed rows). Let V := {^:0<a< n^,a G Z|. 
For any d± G P, we define the combinatorial Grassmannian Grj{d±) to be the set of all non-trivial 
hyperplanes V in (Z/QZ)" such that 

n-d±+i/n^ max Pr(Xi G T/) <p"-'^±. 

f+l<i<n 

For d± = 0, we define Gr^(O) to be the set of all non-trivial hyperplanes such that 

max PriXi G < n". 

f+l<i<n 



37 



We will refer to d± as the combinatorial dimension of V. 

Lemma 9.4 (Small combinatorial dimension, with f fixed rows). For any 6 > we have 

Pr(Ay)<(n-f)r. 

d±eV s.t. T''±g"<(5" V6Gr,(d±) 

Proof. The proof is the same as that for Lemma 15. 2[ also see [1] , [10] , [11] . □ 
Lemma 9.5 (Large combinatorial dimension, with f fixed rows). We have 

^ pt{Av) < {p + o{i)r-f 

d^ev s.t. "LgDim ^yd^ yeGr,(d±) 
Here, CLgOim is the same as in Lemma 15.31 

Proof. The proof is the same as that for Lemma 15. 3| except now we appeal to Lemma IA.2I with 
f > 0. Note that we must assume f < n/2 in order to apply Lemma lA.21 See also [3].|10|.[TT|. □ 

Proposition 9.6 (Medium combinatorial dimension estimate, with f fixed rows). Let < eq be a 

constant much smaller than 1, and let d± be such that (p + CMedDimj^o)"^^ < j"^±g" ^ LgDim ^ 



^/f^ ( 2ina/p) ^^^^ 



n 



VT{Ay)<{p + o{l)r''. 

VeGrf(d±) 

Here we choose the constant CMcdDim.f so that CMedDim,f > (cm + cj + j^q), where Cm and 
are positive absolute constants (in particular, we need Cf such that f < which is true for any 

positive constant Cf since f < O(lnn)). As before, we will prove this proposition by separating V 
with medium combinatorial dimension into two cases: exceptional and unexceptional, which are 
defined below using the definition of Z*i, from Equation (jl7p (this definition is the same as in 
Definition 15.51 with the small change that i and j are required to be between f + 1 and n instead of 
between 1 and n). 

Definition 9.7. Consider a hyperplane V of medium combinatorial dimension (that is, d± satisfies 
the condition in Proposition l9.6p . We say V is unexceptional if there exists an where f+1 < io ^ " 
and there exists a /cq where 1 < /cq < r such that 

max {Pr(X,- G V)} < e,Fr{Zl,^ E V). 

f+l<j<n 

We say V is exceptional if for every i where f + 1 < i < n and for every k where 1 < k < r we 
have 

ei Pr(Z*fc eV)< max {Ft{X, G V)}. (40) 

f+i<j<'" 

In particular, there exists imax such that G V) = maxj-j„i<j<n {Pr{Xj G V)}; and so if V 

is exceptional, then 

ei Pr{Zl_^, eV)< Pr(Xi.„,, G V) for every A:. (41) 
We will refer to ^i^^x ^s the exceptional row. 
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Lemma 9.8 (Unexceptional space estimate, with f fixed rows). If f < ^ ° for some positive 
constant cj, then we have 

V£Gi:f{d±):V is unexceptional 

Notice that the bound is the same as in Lemma 15. 6^ except that we replaced CMedDim with 
CMedDim.f when defining "unexceptional". 

Proof. The proof follows in the same way as that for Lemma l5.6t however, when replacing rows Xi 
of Nj^n with rows Zi that concentrate more sharply on V, we must take care to only replace random 
rows of Nj^n (i-e., rows Xi, . . . ,Xj must not be replaced by Zi). See Appendix [B] for details. □ 

In the exceptional case. The same structure theorem (Theorem 16. ip holds, leading to the fol- 
lowing lemma. 

Lemma 9.9 (Exceptional space estimate, with f fixed rows). If f < ^ 2in(i/p) ~ '^i^fj Inn, then 

Pr(^y)<p"/'- (42) 

VG:Gr{d±):V is exceptional 

Note that this upper bound is dramatically worse than the analogous upper bound in Lemma [5. 71 
of n-t+°W. 

Proof. As in Lemma [5. 71 the main step in the proof is applying the structure theorem (Theorem lG.ip . 
In the current context. Inequality ()20p holds with n — f as the exponent instead of n (since there are 
only n — f random rows). If we combine this modified version of Inequality ()20p with Inequality (j2ip . 
then we have the bound 

^ Fr{Ay) < n-t+°(") Pr(X,_ G F)"" Pr(X,_ G y)"-f 

yGGrf((i±): 
V is exceptional 

= n-?+°(")pr(x,_ey)-f, 

where by assumption Xi^^^^^ is the random row such that Pr(^imax ^ ^) ~ ^^^f+i<i<n 

MXi G V). 

In order for this upper bound to achieve the desired bound in Inequality (j42p . it is sufficient to have 

n-t+°(") Pr(Xi_ G y)-f < p^/-. (43) 

Using the assumption that Pr(Xjj^^^ ^ V) > {p + CMedDimjeo)"''^ > P""^^ (since V is of medium 
combinatorial dimension), we see that Inequality (j43p holds whenever 

f < I - 0(1)1 Inn, 

^-V21n(l/p) 

which completes the proof. □ 
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A Two background results 

A.l A version of the Littlewood-OfFord result in Z/QZ 

If 5 C Q, then we can clear denominators and prove (as in Lemma 2.4]) the large combinatorial 
dimension estimate in M instead of working in Z/QZ, in which case we can also use the Littlewood- 
Offord result over M (see \12\ Corollary 7.13]), instead of the version over TLjQTL given here in 
Lemma lA. II When working in M, the integral approximation of Inequality (I44p can be replaced by 
a limit going to infinity, and we do not need any extra assumptions on Q. In particular, we may 
take Q « exp(exp(Cn)) (see Remark l4.2p . 

For Q sufficiently large with respect to r, and n, it is clear that we have 

\- y (l-2g + 29cos(27r^/g))'^/'' < /"\l-2q + 2qcos(27rt))'^/'' (44) 
Q In n 

for all 1 < /c < n. 

Lemma A.l. Let Q be sufficiently large to satisfy Inequality (|44p . and let vi,. . . ,Vn G TLjQTL he 
such that vi, . . . ,Vk are nonzero. Let {aj}^^-^ be a collection of random variables that are p-bounded 
of exponent r, and let := aivi + • • • + otnVn- Then, for every x € "L/QZ, we have 

where clo o,n absolute constant. 

Proof. Our proof is closely modeled on the proof of [121 Corollary 7.13]. Let (3^^ be the sym- 
metric random variables from the definition of p-bounded of exponent r corresponding to aj (see 
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Equation Q). Then, we can compute 

Pr(X. = x)<l UmeQ{a,a,m (note that a, = for , > 



- n A 2^ |IE(eQ(ajajO)l^ ) (Holder's inequahty) 



\ ^ (where jo corresponds to 

< — y |E(eQ(ajpajp^))| the largest factor in the 

Q .^j^ioi previous hnc) 



k/r 

'-JO 



E l-/^ + /iE^'jo,.cos(27r6,,,,z;,„e/Q) if exponent 

<^ ^ (l-2g + 2gcos(27r6jo,ii;jo^/Q))''/'' (since ^p^^,! > 2q) 

= — (1 — 2g + 2gcos(27r,^/(5))^'''' (by reordering the sum) . 

Combining the above inequalities with Inequality (j44p and following the proof of |121 Corollary 7.13] 
to bound the integral, we have 

/■I 1 
Vx(X^ = x)< / (l-2(? + 2(7cos(27rt))''/'' + - 

_ CLoVr _ Q f ^ 



where clo is an absolute constant. □ 
A. 2 A generalization of a lemma due to Komlos [6] 

This lemma is a generalization of the result in [6] (see also [21 Lemma 14.10], jH Section 3.1], and 
[101 Lemma 5.3]). 



Lemma A. 2. Fix n, and let p be a positive constants such that < p < 1 and let r be a positive 
integer constant. Consider the matrix Nf n taking values in Z/QZ, where f < re/2 and Q is large 
enough to satisfy Inequality (I44p . If the collection of random entries in Nj^n is p -bounded of exponent 
r, then 



Pr [there exists v G i7i such that Nf^n • v = j < (p + o(l))" ^, 

where 

:= |(fi, . . . , Vn) G TLjQTL : at most (n — f) ^1 — + 1 o/ the Vi are nonzero^ \ {0}, 

where the constant c can be taken to be c> 21n(100/p), and where denotes the zero vector. 
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Proof. Let = {there exists v £ with at most k nonzero coordinates such that N^^n ' v = 0}. 
Clearly, 

Pr ^there exists v £ 9.i such that N^.^ • f = 0^ < ^ Pr(-Efc \ ^fc-i)- 

l<fc<(n-f)(l-if;^)+l 

Let 5 be the set of all possible values that could appear as entries in A^f,n) and let N^^n\j^ 
be the n hj k matrix consisting of columns ji, . . . ,jk of Nf ^. Following [6l Lemma 2] (see also |2 
Lemma 14.10] and [10\ Lemma 5.3]) we can write 

FiiEk\Ek-i)< EE E Pr(RwSpn,^,..._,^_^,^)Pr(RwIn,„„.,,,_,,H), 

l<ji<- l<ii<- H a [k - 1)- 
•■■<Jfc5:"- ■■■<*fe-i<"' dimensional 
hyperplane 
spanned by S'' 

where 

RwSpUjj^ := jrows h, . . . of ^f,n|j^^,„j^ span ifj , and 

RwLijj , := |all rows of ]^f,n\j^ except ii, . . . ,ik-i are in ff| . 

Let U{k,p,q) be a uniform upper bound for Pr(row i is in H), where f + 1 < i < n and q is 
the constant from Definition 12. II (here, we mean uniform with respect to the index sets {ji, . . . ,jk} 
and {ii, . . . , ik})- Then we have 



Pr(^fc\^fc_l) < U{k,p,q) 



n-fc-f+l 



n\ / n 
k)\k-l 



since k — 1 fixed rows of N^^n\j^ ^, can span at most 1 hyperplane H of dimension k — \. 



28.2 



For k < — (a constant), we can set U{k,p,q) = p hy the Weighted Odlyzko Lemma (see 
p^'q 

Lemma fB.ip . giving us a bound of 

Fr{Ek\Ek^i)<{p + o{l)r-l (45) 

For ^ <k<(n — f)(l — ) + 1, we use Lemma [A. II to set U(k,p,q) = Since 

p q \ inn/ v 5'^ 

(fc)(fc-i)<?wethus have 



Pr(^fc \ ^fc_i) < -2^' 



^ n-fc-f + l 

1 -2n / '^LO^ 



n V 9^ 

As a function of fc, this upper bound has strictly positive second derivative; thus, the largest upper 

bound will occur at one of the extremal values of /e = or /c = (n — f) (1 — + 1, and a bit 

of computation shows that 

Fr{Ek\Ek.i)<-0{p^-^). (46) 
n 

Summing the bounds in Inequalities (|45|) and (j46|) completes the proof. □ 
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B The unexceptional case with f fixed rows 



This section is adapted from the proof of [111 Lemma 4.1], and proves Lemma 15.61 by setting f = 0. 
Assume that f < and let m be the closest integer to Let Zi, . . . , Zm be i.i.d. copies 

of the unexceptional row vector Z*^ from Definition 19.71 so ei Pr(Z, £ V) > Pr(Xj G V) for all 
f + 1 < i < n. We will need the following version of the Weighted Odlyzko Lemma: 

Lemma B.l. [cf. dU Lemma 4.3] or [H Section 3.2]] For 1 < i, let Wj_i be an + i - 1)- 
dimensional subspace containing Xi, . . . , (which are fixed, linearly independent row vectors). 
Then 

Proof. Since has dimension f + z — 1, there exists a set of f + i — 1 "determining" coordinates 

such that if a vector V £ Wj_i, then the f + i — 1 "determining" coordinates determine the values 
of the remaining n — f — i + 1 coordinates. Since the maximum probability that any of the n/r 
random coordinates in Zi takes a given value is at most 1 — /x = p + j^, and since there are at least 
J — j — i + 1 of the random coordinates in Zi that are not among the "determining" coordinates, 
we have the desired upper bound. □ 

Let Vb := SpanjXi, . . . , Xf}, the space spanned by the f fixed rows, and for 1 < i < m let By^i 
be the event that Zi, . . . , Zm are linearly independent in V \V(). We have the following analog of 
Lemma 15.81 (and also [111 Lemma 4.4]): 

Lemma B.2 (see Lemma 4.4 in [llj). Let m, f, and By^m be as defined above. Then, 
Proof. Using Bayes' Identity, we have 

m 

PT{Bv,m) = l[PT{Bv,^\Bv,i-l), (47) 
1=1 

where By^ denotes the full space of the Z^. Conditioning on a particular instance of .Z^i, . . . , 
in Bv,i-i, we have that 

PT{Bv,i\Bv,^^l) = Pr(Z, eV)- Pr(Z, E W^.^), 

where Wi-i denotes the {f + i — l)-dimensional space spanned by Xi, . . . ,Xf and Zi, . . . , 

We will now establish a uniform bound that does not depend on which particular instance of 

Zi, . . . , Zi^i in Bv,i-i that we fixed by conditioning. By the definition of unexceptional, we have 

Pr(Zi eV)> — max Pv(Xi G V), 

ei f+l<i<n 

and by the Weighted Odlyzko Lemma (see Lemma iB.ip . we have 



PiiZi eWi-i) < (p + — ] <(p + 
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Using Taylor's Theorem with remainder (for example), one can show that 

{P+ 77^1 < ^{P + CMcdDimeo) ' < - max Pr(Ai G V), 

\ 100/ 2n 77, f+l<i<n 

so long as CMcdDim > jgo + Cm + > + (cm + Cf)pln and ?^ is sufficiently large (the second 
inequality in the display above is the definition of medium combinatorial dimension) . 
Thus 

Fr{Bv.i\Bv,i-i) >-( max Fi{Xi G V)] f 1 - -) , 
and plugging this estimate back into Inequality ()47p we get 



Pr (Sy,m) > P 



p(n) / maxf4.i<i<nPr(Xj £ y) 



□ 



To conclude Lemma 19.81 (which implies Lemma 15.61 by setting f = 0), we will proceed as in the 
proof for Lemma 4.1]. 

Let Zi, . . . , Zra be i.i.d. copies of Z*^ that are independent of the random rows -'^f+i, . . . , ^n- 
Using independence and Bayes' Identity we have 

Pr(^V^) = Pr(Ay|Sv,m) = ^ -^^■-) < Pr(Av^ A i?y,n.)p-°(") ^ 



VY{By^rn) ' V maXf+i<i<„ Pr (Xj G F) 

Because the Zi are linearly independent in \ Vq) we know that there is a subset / C {f + 1, f + 
2, . . . , 77} of cardinality |/| = 777, such that {Zi, . . . , Zm} U {Xi : i ^ 1} spans V. Let Cv,i be the 
event that {Zi, . . . , Zm} U {Xi : i ^ 1} spans V. Then we have 

Ft{Av a Bv,m) < Pr (Cyj A {X^ G V : 7 € I}) 

/C{f+l,...,n} 
|/|=m 



<f max Pr(XiGy)^ V Pr(C7yj). 



/C{f+l,...,n} 
|/|=m 

Summing the above inequality over all unexceptional V (note that Pr(Cv^7) < 1) and combining 
with the bound for Pr{Av) above gives us 

y Fr(Av)<( max Pr(Xi£V)] (^"""Hp""^"^!^ 

This completes the proof of the estimate for unexceptional V. 
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